2025-11-01 08:00:07 [scrapy.utils.log] (PID: 95) INFO: Scrapy 2.12.0 started (bot: catalog_extraction)
2025-11-01 08:00:07 [scrapy.utils.log] (PID: 95) INFO: Versions: lxml 5.3.1.0, libxml2 2.12.9, cssselect 1.3.0, parsel 1.10.0, w3lib 2.3.1, Twisted 24.11.0, Python 3.11.13 (main, Jun 10 2025, 23:54:42) [GCC 12.2.0], pyOpenSSL 25.0.0 (OpenSSL 3.4.1 11 Feb 2025), cryptography 44.0.2, Platform Linux-6.9.12-x86_64-with-glibc2.36
2025-11-01 08:00:07 [packaging_hero] (PID: 95) INFO: Starting extraction spider packaging_hero...
2025-11-01 08:00:07 [scrapy.addons] (PID: 95) INFO: Enabled addons:
[]
2025-11-01 08:00:07 [py.warnings] (PID: 95) WARNING: /usr/local/lib/python3.11/site-packages/scrapy/utils/request.py:120: ScrapyDeprecationWarning: 'REQUEST_FINGERPRINTER_IMPLEMENTATION' is a deprecated setting.
It will be removed in a future version of Scrapy.
  return cls(crawler)

2025-11-01 08:00:07 [scrapy.extensions.telnet] (PID: 95) INFO: Telnet Password: 19d6dacea6e56a3a
2025-11-01 08:00:07 [py.warnings] (PID: 95) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2025-11-01 08:00:07 [scrapy.middleware] (PID: 95) INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.closespider.CloseSpider',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'spidermon.contrib.scrapy.extensions.Spidermon']
2025-11-01 08:00:07 [scrapy.crawler] (PID: 95) INFO: Overridden settings:
{'BOT_NAME': 'catalog_extraction',
 'CONCURRENT_ITEMS': 250,
 'CONCURRENT_REQUESTS': 24,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/lib/scrapyd/logs/catalog_extraction/packaging_hero/c4cb0208b6f811f0aeb54200a9fe0102.log',
 'LOG_FORMAT': '%(asctime)s [%(name)s] (PID: %(process)d) %(levelname)s: '
               '%(message)s',
 'LOG_LEVEL': 'INFO',
 'NEWSPIDER_MODULE': 'catalog_extraction.spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_poet.ScrapyPoetRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['catalog_extraction.spiders'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': None}
2025-11-01 08:00:08 [scrapy_poet.injection] (PID: 95) INFO: Loading providers:
 [<class 'scrapy_poet.page_input_providers.HttpRequestProvider'>,
 <class 'scrapy_poet.page_input_providers.HttpResponseProvider'>,
 <class 'scrapy_poet.page_input_providers.HttpClientProvider'>,
 <class 'scrapy_poet.page_input_providers.PageParamsProvider'>,
 <class 'scrapy_poet.page_input_providers.RequestUrlProvider'>,
 <class 'scrapy_poet.page_input_providers.ResponseUrlProvider'>,
 <class 'scrapy_poet.page_input_providers.StatsProvider'>]
2025-11-01 08:00:08 [scrapy.middleware] (PID: 95) INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scraping_utils.middlewares.downloaders.ProxyManagerDownloaderMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scraping_utils.middlewares.downloaders.HeadersSpooferDownloaderMiddleware',
 'scrapy_poet.InjectionMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy_poet.DownloaderStatsMiddleware']
2025-11-01 08:00:08 [NotFoundHandlerSpiderMiddleware] (PID: 95) INFO: NotFoundHandlerSpiderMiddleware running on PRODUCTION environment.
2025-11-01 08:00:08 [scrapy.middleware] (PID: 95) INFO: Enabled spider middlewares:
['catalog_extraction.middlewares.NotFoundHandlerSpiderMiddleware',
 'catalog_extraction.middlewares.FixtureSavingMiddleware',
 'scrapy_poet.RetryMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware']
2025-11-01 08:00:08 [scrapy.middleware] (PID: 95) INFO: Enabled item pipelines:
['catalog_extraction.pipelines.DuplicatedSKUsFilterPipeline',
 'catalog_extraction.pipelines.DiscontinuedProductsAdjustmentPipeline',
 'catalog_extraction.pipelines.PriceRoundingPipeline',
 'scraping_utils.pipelines.AttachSupplierPipeline',
 'spidermon.contrib.scrapy.pipelines.ItemValidationPipeline']
2025-11-01 08:00:08 [scrapy.core.engine] (PID: 95) INFO: Spider opened
2025-11-01 08:00:08 [scrapy.extensions.closespider] (PID: 95) INFO: Spider will stop when no items are produced after 1800 seconds.
2025-11-01 08:00:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-11-01 08:00:08 [scrapy.extensions.telnet] (PID: 95) INFO: Telnet console listening on 127.0.0.1:6025
2025-11-01 08:00:11 [ProxyManagerDownloaderMiddleware] (PID: 95) INFO: Using brd-customer-hl_13cda1e4-zone-main_datacenter_proxy as the default proxy for ProxyManagerDownloaderMiddleware.
2025-11-01 08:00:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1-4-x-2-repair-rework-by-fluorescent-red-labels-ph-411295>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-50-red-cable-ties-ph-441169>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-11-1-8-x-4-blue-shelf-bins-ph-711335> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-11-1-8-x-4-blue-shelf-bins-ph-711335 returned 404 status code.
2025-11-01 08:00:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-4-1-8-x-4-green-shelf-bins-ph-711307> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-4-1-8-x-4-green-shelf-bins-ph-711307 returned 404 status code.
2025-11-01 08:00:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-4-1-8-x-4-red-shelf-bins-ph-711309> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-4-1-8-x-4-red-shelf-bins-ph-711309 returned 404 status code.
2025-11-01 08:00:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-4-1-8-x-4-yellow-shelf-bins-ph-711311> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-4-1-8-x-4-yellow-shelf-bins-ph-711311 returned 404 status code.
2025-11-01 08:00:12 [scrapy_poet._request_fingerprinter] (PID: 95) WARNING: Cannot serialize page params {'original_response': <200 https://www.packaginghero.com/1-1-4-x-2-rush-fluorescent-red-labels-ph-411007>} of request <POST https://www.packaginghero.com/Product/GetPriceWithInventory> as JSON. This can be an issue if you have requests that are identical except for their page params, because unserializable page params are treated the same as missing or empty page params for purposes of request fingerprinting (see https://docs.scrapy.org/en/latest/topics/request-response.html#request-fingerprints). This will be the only warning about this issue, other requests might be also affected.
2025-11-01 08:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-8-3-8-x-4-clear-shelf-bins-ph-711327> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-8-3-8-x-4-clear-shelf-bins-ph-711327 returned 404 status code.
2025-11-01 08:00:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-8-3-8-x-4-blue-shelf-bins-ph-711325> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-8-3-8-x-4-blue-shelf-bins-ph-711325 returned 404 status code.
2025-11-01 08:00:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-6-5-8-x-4-red-shelf-bins-ph-711321> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-6-5-8-x-4-red-shelf-bins-ph-711321 returned 404 status code.
2025-11-01 08:00:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-6-5-8-x-4-blue-shelf-bins-ph-711315> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-6-5-8-x-4-blue-shelf-bins-ph-711315 returned 404 status code.
2025-11-01 08:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-5-32-yellow-plastic-twist-ties-ph-345273>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-double-sided-foam-tape-ph-652211 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-72-yds-double-sided-foam-tape-ph-652169 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-72-yds-removable-double-sided-foam-tape-ph-652165 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-72-yds-double-sided-foam-tape-ph-652161 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-1-8-white-double-sided-foam-tape-ph-652157 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-1-8-white-double-sided-foam-tape-ph-652153 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-removable-double-sided-foam-tape-ph-652149 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-double-sided-foam-tape-ph-652145 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-removable-double-sided-foam-tape-ph-652141 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-double-sided-foam-tape-ph-652137 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-double-sided-foam-tape-ph-652133 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-double-sided-foam-tape-ph-652129 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-72-yds-double-sided-foam-tape-ph-652121 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-72-yds-double-sided-foam-tape-ph-652113 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-36-yds-1-8-white-double-sided-foam-tape-ph-652109 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-36-yds-1-8-white-double-sided-foam-tape-ph-652105 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-36-yds-removable-double-sided-foam-tape-ph-652101 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-36-yds-double-sided-foam-tape-ph-652097 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:25 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-36-yds-double-sided-foam-tape-ph-652089 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-36-yds-double-sided-foam-tape-ph-652085 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:25 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:00:25 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-72-yds-double-sided-foam-tape-ph-652067 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-36-yds-double-sided-foam-tape-ph-652079>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-72-yds-removable-double-sided-foam-tape-ph-652061 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-72-yds-double-sided-foam-tape-ph-652055 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-36-yds-1-8-white-double-sided-foam-tape-ph-652049 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:26 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-36-yds-1-8-white-double-sided-foam-tape-ph-652043 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-36-yds-removable-double-sided-foam-tape-ph-652037 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-36-yds-double-sided-foam-tape-ph-652031 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:28 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-36-yds-removable-double-sided-foam-tape-ph-652023 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-36-yds-double-sided-foam-tape-ph-652017 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:28 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-36-yds-double-sided-foam-tape-ph-652011 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:28 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:00:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-36-yds-double-sided-foam-tape-ph-652005>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:29 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:00:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-60-yds-3m-401-233-masking-tape-ph-681231>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:30 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:00:30 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:32 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/15-x-11-1-8-x-6-kraft-easy-fold-mailers-ph-211799> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/15-x-11-1-8-x-6-kraft-easy-fold-mailers-ph-211799 returned 404 status code.
2025-11-01 08:00:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/15-x-15-x-3-flat-corrugated-boxes-ph-101629>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-30-1-1-2-mil-flat-poly-bag-ph-311944>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:37 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:00:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-90gablown-hand-stretch-film-ph-363181>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-8-1-4-x-9-ivory-stack-hang-bins-ph-711265> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-8-1-4-x-9-ivory-stack-hang-bins-ph-711265 returned 404 status code.
2025-11-01 08:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-8-1-4-x-9-black-stack-hang-bins-ph-711261> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-8-1-4-x-9-black-stack-hang-bins-ph-711261 returned 404 status code.
2025-11-01 08:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:00:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-1-2-x-2-1-2-x-30-225-edge-protectors-cased-ph-461059>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-1-2-x-30-kraft-crimped-end-tubes-ph-213373>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/21-x-6-x-2-white-corrugated-mailers-ph-211661>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/29-x-24-x-24-corrugated-boxes-ph-102713>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:00 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/22-1-2-x-24-1-2-black-can-liners-ph-751137> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/22-1-2-x-24-1-2-black-can-liners-ph-751137 returned 404 status code.
2025-11-01 08:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:01 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:01 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-circle-ok-to-ship-blue-labels-ph-412441>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-circle-sun-white-days-of-the-week-labels-ph-412537>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-55-yds-orange-tape-logic-box-tape-ph-612169>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 351 pages (at 351 pages/min), scraped 134 items (at 134 items/min)
2025-11-01 08:01:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-55-yds-white-3m-373-box-tape-ph-613151>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-60-black-3m-safety-walk-tape-610-ph-633029>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:13 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-5-yds-clear-3m-f9473.c-vhb-tape-ph-696179> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-5-yds-clear-3m-f9473.c-vhb-tape-ph-696179 returned 404 status code.
2025-11-01 08:01:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-60-yds-3m-203-masking-tape-ph-681711>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:16 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-5-black-premium-anti-fatigue-mat-ph-737406> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-5-black-premium-anti-fatigue-mat-ph-737406 returned 404 status code.
2025-11-01 08:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-5-yds-3m-4016-double-sided-foam-tape-ph-652007>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/aluminum-foil-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:17 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-60-yds-3m-501+-masking-tape-ph-681753> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-60-yds-3m-501+-masking-tape-ph-681753 returned 404 status code.
2025-11-01 08:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-60-yds-industrial-aluminum-foil-tape-ph-684033 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-60-yds-industrial-aluminum-foil-tape-ph-684029 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:19 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-60-yds-industrial-aluminum-foil-tape-ph-684025 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-60-yds-industrial-aluminum-foil-tape-ph-684021 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-electrical-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-green-white-striped-vinyl-safety-tape-ph-631073 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-orange-3-pack-solid-vinyl-safety-tape-ph-631215 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-green-solid-vinyl-safety-tape-ph-631203 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-green-3-pack-solid-vinyl-safety-tape-ph-631199 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-yds-orange-solid-vinyl-safety-tape-ph-631219>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-blue-3-pack-solid-vinyl-safety-tape-ph-631191 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-yds-blue-solid-vinyl-safety-tape-ph-631195>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-black-solid-vinyl-safety-tape-ph-631171 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-18-yds-heavy-duty-adhesive-transfer-tape-ph-651023 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-36-yds-general-purpose-adhesive-transfer-tape-ph-651031 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-18-yds-heavy-duty-adhesive-transfer-tape-ph-651003 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-36-yds-general-purpose-adhesive-transfer-tape-ph-651015 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-36-yds-general-purpose-adhesive-transfer-ph-651027>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-18-yds-heavy-duty-adhesive-transfer-tape-ph-651007>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:25 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-36-yds-general-purpose-adhesive-transfer-tape-ph-651011 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-red-white-striped-vinyl-safety-tape-ph-631121 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:25 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-yds-black-3-pack-solid-vinyl-safety-tape-ph-631167>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-red-white-striped-vinyl-safety-tape-ph-631115 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:27 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-green-white-striped-vinyl-safety-tape-ph-631067 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-black-yellow-striped-vinyl-safety-tape-ph-631037 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:27 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-black-yellow-striped-vinyl-safety-tape-ph-631031 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-black-white-striped-vinyl-safety-tape-ph-631025 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-black-white-striped-vinyl-safety-tape-ph-631019 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-yellow-solid-vinyl-safety-tape-ph-631145 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-yellow-3-pack-solid-vinyl-safety-tape-ph-631139 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-red-solid-vinyl-safety-tape-ph-631109 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-red-3-pack-solid-vinyl-safety-tape-ph-631103 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-36-yds-white-solid-vinyl-safety-tape-ph-631133>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-36-yds-white-3-pack-solid-vinyl-safety-tape-ph-631127>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-purple-solid-vinyl-safety-tape-ph-631097 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-purple-3-pack-solid-vinyl-safety-tape-ph-631091 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:29 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-orange-solid-vinyl-safety-tape-ph-631085 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-orange-3-pack-solid-vinyl-safety-tape-ph-631079 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-green-solid-vinyl-safety-tape-ph-631061 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:30 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:30 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-green-3-pack-solid-vinyl-safety-tape-ph-631055 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:30 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-blue-solid-vinyl-safety-tape-ph-631049 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-blue-3-pack-solid-vinyl-safety-tape-ph-631043 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-black-solid-vinyl-safety-tape-ph-631013 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:30 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:30 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-36-yds-black-3-pack-solid-vinyl-safety-tape-ph-631005 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:31 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-60-yds-3m-234-masking-tape-ph-681315>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:40 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-4-x-60-yds-3m-301+-masking-tape-ph-681335> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-4-x-60-yds-3m-301+-masking-tape-ph-681335 returned 404 status code.
2025-11-01 08:01:40 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-4-x-60-yds-3m-401+-233+-masking-tape-ph-681451> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-4-x-60-yds-3m-401+-233+-masking-tape-ph-681451 returned 404 status code.
2025-11-01 08:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-60-yds-3m-8981-strapping-tape-ph-642123>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/aluminum-foil-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:41 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-4-x-60-yds-3m-501+-masking-tape-ph-681455> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-4-x-60-yds-3m-501+-masking-tape-ph-681455 returned 404 status code.
2025-11-01 08:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:42 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-4-x-60-yds-3m-860-poly-strapping-tape-ph-643025> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-4-x-60-yds-3m-860-poly-strapping-tape-ph-643025 returned 404 status code.
2025-11-01 08:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/strapping-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-x-58-clear-can-liners-ph-751135>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-x-61-wall-mounted-panel-rack-ph-714107>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/strapping-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-x-8-x-8-double-wall-boxes-ph-115503>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-58-black-can-liners-ph-751181> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-58-black-can-liners-ph-751181 returned 404 status code.
2025-11-01 08:01:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/37-x-1000-bedford-2-ply-toliet-tissue-ph-821013>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-58-clear-can-liners-ph-751129> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-58-clear-can-liners-ph-751129 returned 404 status code.
2025-11-01 08:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:45 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-8-x-1-1-4-electrostatic-sensitive-devices-labels-ph-411595>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:45 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-8-x-13-16-white-merchandise-tag-strung-magenta-string-ph-426003>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-fluorescent-red-inventory-rectangle-labels-ph-412483>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-fragile-handle-with-care-labels-ph-411781>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-open-immediately-fluorescent-green-labels-ph-411141>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:01:58 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-priority-fluorescent-red-labels-ph-411503>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:01 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/48-x-42-x-48-4-mil-clear-pallet-covers-ph-351175>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:02:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/48-x-42-x-66-3-mil-black-pallet-covers-ph-351181>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:02:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 693 pages (at 342 pages/min), scraped 252 items (at 118 items/min)
2025-11-01 08:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-green-inventory-circle-labels-ph-412827>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:02:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-1-2-x-4-3-4-x-19-1-mil-gusseted-poly-bag-ph-318137>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-1-4-x-2-1-4-x-15-1-1-2-mil-gusseted-poly-bag-ph-318141> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-1-4-x-2-1-4-x-15-1-1-2-mil-gusseted-poly-bag-ph-318141 returned 404 status code.
2025-11-01 08:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/5-16-x-12-x-188-parcel-ready-bubble-rolls-ph-531171 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/5-16-x-24-x-188-parcel-ready-bubble-rolls-ph-531185 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/5-16-x-48-x-188-parcel-ready-bubble-roll-ph-531193 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:02:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:29 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/63-chrome-poles-2-pack-ph-715377> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/63-chrome-poles-2-pack-ph-715377 returned 404 status code.
2025-11-01 08:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-5-8-x-2-3-4-stack-hang-bin-dividers-ph-712105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-5-8-x-2-3-4-stack-hang-bin-dividers-ph-712105 returned 404 status code.
2025-11-01 08:02:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-shelf-wire-shelving-with-red-bins-ph-715127> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-shelf-wire-shelving-with-red-bins-ph-715127 returned 404 status code.
2025-11-01 08:02:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:02:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-1-2-x-11-crystal-clear-rectangle-laser-labels-ph-414667>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:34 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-10-kraft-0-padded-mailers-ph-251105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-10-kraft-0-padded-mailers-ph-251105 returned 404 status code.
2025-11-01 08:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:39 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/8-1-2-x-12-kraft-2-padded-mailers-ph-251125> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/8-1-2-x-12-kraft-2-padded-mailers-ph-251125 returned 404 status code.
2025-11-01 08:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:02:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-16-1-mil-flat-poly-bag-ph-311702>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:40 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-shelf-wire-shelving-with-green-bins-ph-715139> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-shelf-wire-shelving-with-green-bins-ph-715139 returned 404 status code.
2025-11-01 08:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/8-3-8-x-4-1-2-stack-hang-bin-dividers-ph-712103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/8-3-8-x-4-1-2-stack-hang-bin-dividers-ph-712103 returned 404 status code.
2025-11-01 08:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:55 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1.57-x-1181-black-datamax-thermal-transfer-ribbons-wax-ph-415103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1.57-x-1181-black-datamax-thermal-transfer-ribbons-wax-ph-415103 returned 404 status code.
2025-11-01 08:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-black-stack-hang-bin-ph-711177>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:02:56 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-1-2-x-16-kraft-5-padded-mailers-ph-251155> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-1-2-x-16-kraft-5-padded-mailers-ph-251155 returned 404 status code.
2025-11-01 08:02:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-lb-gold-and-red-metallic-crinkle-paper-ph-951127>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:58 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-7-8-x-11-x-5-black-stack-hang-bins-ph-711191> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-7-8-x-11-x-5-black-stack-hang-bins-ph-711191 returned 404 status code.
2025-11-01 08:02:58 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-7-8-x-11-x-5-yellow-stack-hang-bin-ph-711197> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-7-8-x-11-x-5-yellow-stack-hang-bin-ph-711197 returned 404 status code.
2025-11-01 08:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:58 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-red-stack-hang-bin-ph-711165> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-red-stack-hang-bin-ph-711165 returned 404 status code.
2025-11-01 08:02:58 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-green-stack-hang-bin-ph-711175> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-green-stack-hang-bin-ph-711175 returned 404 status code.
2025-11-01 08:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:03:03 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-black-stack-hang-bin-ph-711149> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-black-stack-hang-bin-ph-711149 returned 404 status code.
2025-11-01 08:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-x-6-x-4-long-corrugated-boxes-ph-101127>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-1-2-x-12-1-2-x-15-double-wall-boxes-ph-115109>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:03:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-1-2-x-12-1-2-x-1-kraft-easy-fold-mailer-ph-211771>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-1-4-x-9-1-4-x-9-corrugated-boxes-ph-101351>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 1031 pages (at 338 pages/min), scraped 408 items (at 156 items/min)
2025-11-01 08:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-60-yds-3m-987-adhesive-transfer-tape-ph-651157>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:03:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-6-x-2-white-corrugated-mailers-ph-211595>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:13 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 08:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:03:28 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/16-x-11-x-8-yellow-stack-hang-bins-ph-711253> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/16-x-11-x-8-yellow-stack-hang-bins-ph-711253 returned 404 status code.
2025-11-01 08:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:29 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/16-x-11-x-8-ivory-stack-hang-bins-ph-711251> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/16-x-11-x-8-ivory-stack-hang-bins-ph-711251 returned 404 status code.
2025-11-01 08:03:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-circle-thu-fluorescent-green-days-of-the-week-labels-ph-412189>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:29 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:03:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-1-2-mil-reclosable-poly-bag-ph-315014>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/22-x-20-x-10-corrugated-boxes-ph-102263>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/22-x-22-x-10-corrugated-boxes-ph-102269>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-20-yds-yellow-electrical-tape-ph-683171 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-20-yds-yellow-10-pack-electrical-tape-ph-683169 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-20-yds-white-electrical-tape-ph-683167 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-20-yds-white-10-pack-electrical-tape-ph-683165 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-20-yds-red-electrical-tape-ph-683163 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-20-yds-red-10-pack-electrical-tape-ph-683159 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-20-yds-purple-electrical-tape-ph-683155 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-20-yds-purple-10-pack-electrical-tape-ph-683151 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-20-yds-orange-electrical-tape-ph-683147 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-20-yds-orange-10-pack-electrical-tape-ph-683143 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-20-yds-green-electrical-tape-ph-683139 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-20-yds-green-10-pack-electrical-tape-ph-683135 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-20-yds-gray-electrical-tape-ph-683131 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-20-yds-gray-10-pack-electrical-tape-ph-683127 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-20-yds-brown-electrical-tape-ph-683123 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-20-yds-brown-10-pack-electrical-tape-ph-683119 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-20-yds-blue-electrical-tape-ph-683115 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-20-yds-blue-10-pack-electrical-tape-ph-683111 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-20-yds-black-electrical-tape-ph-683107 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-20-yds-black-10-pack-electrical-tape-ph-683103 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 08:03:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:03:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/machine-length-carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:01 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:01 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:02 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-105-corrugated-rib-runners-ph-737576> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-105-corrugated-rib-runners-ph-737576 returned 404 status code.
2025-11-01 08:04:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-110-yds-clear-800-economy-tape-ph-611059>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-1000-yds-clear-900-economy-tape-ph-619029 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-1000-yds-clear-700-economy-tape-ph-619027 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-1000-yds-clear-900-economy-tape-ph-619015 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-1000-yds-white-700-economy-tape-ph-619023 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-110-yds-caution-if-seal-is-broke-printed-tape-ph-617005> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-110-yds-caution-if-seal-is-broke-printed-tape-ph-617005 returned 404 status code.
2025-11-01 08:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-1000-yds-green-700-economy-tape-ph-619019 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-1000-yds-clear-700-economy-tape-ph-619011 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-1000-yds-clear-600-economy-tape-ph-619007 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 1363 pages (at 332 pages/min), scraped 558 items (at 150 items/min)
2025-11-01 08:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-60-yds-black-3m-6969-duct-tape-ph-682101>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-10-black-marble-anti-fatigue-mat-ph-737122> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-10-black-marble-anti-fatigue-mat-ph-737122 returned 404 status code.
2025-11-01 08:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:11 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:13 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/safety-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:14 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/safety-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:20 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/strapping-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:21 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/39-x-46-sure-sak-can-liners-ph-752105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/39-x-46-sure-sak-can-liners-ph-752105 returned 404 status code.
2025-11-01 08:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:22 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:23 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:04:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3m-8511-dust-respirator-with-valve-ph-723121>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:23 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3m-bumpon-clear-dome-5-16-x-1-12-ph-638007>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:25 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3m-8210-dust-respirator-ph-723115> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3m-8210-dust-respirator-ph-723115 returned 404 status code.
2025-11-01 08:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:25 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3m-8271-oil-proof-respirator-with-valve-ph-723119> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3m-8271-oil-proof-respirator-with-valve-ph-723119 returned 404 status code.
2025-11-01 08:04:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3m-st181-2-heavy-duty-tape-dispenser-ph-618043>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:26 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:26 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3m-8515-welding-respirator-with-valve-ph-723123> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3m-8515-welding-respirator-with-valve-ph-723123 returned 404 status code.
2025-11-01 08:04:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:29 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:31 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3m-6003-reusable-respirator-ph-723107> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3m-6003-reusable-respirator-ph-723107 returned 404 status code.
2025-11-01 08:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:36 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-60-brown-economy-vinyl-carpet-mat-ph-737544> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-60-brown-economy-vinyl-carpet-mat-ph-737544 returned 404 status code.
2025-11-01 08:04:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:36 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-60-premium-anti-fatigue-mat-ph-737437> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-60-premium-anti-fatigue-mat-ph-737437 returned 404 status code.
2025-11-01 08:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:37 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-60-blue-economy-vinyl-carpet-mat-ph-737543> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-60-blue-economy-vinyl-carpet-mat-ph-737543 returned 404 status code.
2025-11-01 08:04:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-60-yds-olive-green-11-mil-gaffers-tape-ph-693131>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-60-yds-orange-10-mil-duct-tape-ph-682167>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:39 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:04:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-light-blue-inventory-circle-labels-ph-412829>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:40 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-1-1-2-white-rectangle-laser-labels-ph-414493>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:45 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-10-brown-waterhog-mat-ph-737245> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-10-brown-waterhog-mat-ph-737245 returned 404 status code.
2025-11-01 08:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:45 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-10-medium-gray-waterhog-mat-ph-737248> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-10-medium-gray-waterhog-mat-ph-737248 returned 404 status code.
2025-11-01 08:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/wholesale-label-protection-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:45 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:04:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-14-4-mil-reclosable-poly-bag-ph-315351>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-12-medium-gray-waterhog-mat-ph-737254> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-12-medium-gray-waterhog-mat-ph-737254 returned 404 status code.
2025-11-01 08:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/6-x-72-yds-clear-2-mil-acrylic-tape-ph-694027 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/5-x-72-yds-clear-2-mil-acrylic-tape-ph-694021 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-72-yds-clear-2-mil-acrylic-tape-ph-694013 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-72-yds-clear-2-mil-acrylic-tape-ph-694009 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-72-yds-clear-18-mil-acrylic-tape-ph-694011 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-72-yds-clear-18-mil-acrylic-tape-ph-694007 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:04:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:04:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-1-direct-thermal-labels-ph-415073>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-16-green-waterhog-mat-ph-737259> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-16-green-waterhog-mat-ph-737259 returned 404 status code.
2025-11-01 08:04:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-3-4-x-2-7-8-fluorescent-pink-13-pt-shipping-tags-ph-423509>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/54-chrome-poles-4-pack-ph-715375>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:01 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-16-brown-waterhog-mat-ph-737257> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-16-brown-waterhog-mat-ph-737257 returned 404 status code.
2025-11-01 08:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:01 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/54-chrome-poles-2-pack-ph-715373> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/54-chrome-poles-2-pack-ph-715373 returned 404 status code.
2025-11-01 08:05:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-12-6-mil-reclosable-poly-bag-ph-315325>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:02 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-clear-stack-hang-bin-ph-711103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-clear-stack-hang-bin-ph-711103 returned 404 status code.
2025-11-01 08:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-12-green-waterhog-mat-ph-737283> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-12-green-waterhog-mat-ph-737283 returned 404 status code.
2025-11-01 08:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 1729 pages (at 366 pages/min), scraped 703 items (at 145 items/min)
2025-11-01 08:05:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-16-medium-gray-waterhog-mat-ph-737290> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-16-medium-gray-waterhog-mat-ph-737290 returned 404 status code.
2025-11-01 08:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-oz-ice-brix-biodegradable-packs-ph-183127>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-shelf-wire-shelving-with-green-bins-ph-715107>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-shelf-wire-shelving-with-red-bins-ph-715111>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-10-1-1-2-mil-resealable-poly-bag-ph-319129>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:13 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/86-chrome-poles-ph-715385> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/86-chrome-poles-ph-715385 returned 404 status code.
2025-11-01 08:05:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/86-chrome-poles-ph-715387> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/86-chrome-poles-ph-715387 returned 404 status code.
2025-11-01 08:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:16 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/8-pt-steel-track-snap-utility-knife-ph-732139> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/8-pt-steel-track-snap-utility-knife-ph-732139 returned 404 status code.
2025-11-01 08:05:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-10-kraft-block-out-labels-ph-412051>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-9-1-mil-flat-poly-bag-ph-311678>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/better-pack-333-plus-lever-gum-tape-dispenser-ph-625001>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:23 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/safety-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:25 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/all-purpose-first-aid-kit-25-person-ph-724101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/all-purpose-first-aid-kit-25-person-ph-724101 returned 404 status code.
2025-11-01 08:05:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/water-activated-tape-dispensers>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/water-activated-tape-dispensers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:26 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/black-sharpie-chisel-tip-markers-ph-734153> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/black-sharpie-chisel-tip-markers-ph-734153 returned 404 status code.
2025-11-01 08:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:26 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/blue-recycling-trash-bag-13-gal-11-mil-ph-757101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/blue-recycling-trash-bag-13-gal-11-mil-ph-757101 returned 404 status code.
2025-11-01 08:05:26 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/blue-recycling-trash-bag-13-gal-15-mil-ph-757103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/blue-recycling-trash-bag-13-gal-15-mil-ph-757103 returned 404 status code.
2025-11-01 08:05:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/breakaway-blue-lanyards-ph-432017>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:27 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/black-marsh-88fx-metal-paint-markers-ph-734109> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/black-marsh-88fx-metal-paint-markers-ph-734109 returned 404 status code.
2025-11-01 08:05:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/brute-flat-trash-can-lid-32-gal-white-ph-743219>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:27 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/blue-sharpie-chisel-tip-markers-ph-734151> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/blue-sharpie-chisel-tip-markers-ph-734151 returned 404 status code.
2025-11-01 08:05:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-100-6-mil-black-poly-sheeting-ph-352147>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:27 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/best-nighthawk-nitrile-gloves-medium-ph-891043> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/best-nighthawk-nitrile-gloves-medium-ph-891043 returned 404 status code.
2025-11-01 08:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/grip-systems-portable-taper-only-gs-100302 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/better-packages-packer-3s-pull-tear-machine-ph-625025 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/better-pack-555es-electronic-dispenser-ph-625013 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:28 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/blue-recycling-trash-bag-33-gal-15-mil-ph-757111> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/blue-recycling-trash-bag-33-gal-15-mil-ph-757111 returned 404 status code.
2025-11-01 08:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/better-pack-333-plus-lever-gum-tape-dispenser-ph-625001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:29 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/box-of-rags-premium-white-10-lb-box-ph-827025> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/box-of-rags-premium-white-10-lb-box-ph-827025 returned 404 status code.
2025-11-01 08:05:29 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/box-of-rags-colored-t-shirt-50-lb-box-ph-827045> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/box-of-rags-colored-t-shirt-50-lb-box-ph-827045 returned 404 status code.
2025-11-01 08:05:29 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/blue-sharpie-magnum-markers-ph-734143> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/blue-sharpie-magnum-markers-ph-734143 returned 404 status code.
2025-11-01 08:05:29 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/blue-recycling-trash-bag-55-60-gal-ph-757117> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/blue-recycling-trash-bag-55-60-gal-ph-757117 returned 404 status code.
2025-11-01 08:05:29 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-flat-trash-can-lid-20-gallon-gray-ph-743179> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-flat-trash-can-lid-20-gallon-gray-ph-743179 returned 404 status code.
2025-11-01 08:05:29 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-flat-trash-can-lid-20-gal-black-ph-743173> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-flat-trash-can-lid-20-gal-black-ph-743173 returned 404 status code.
2025-11-01 08:05:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/product/51109>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-10-x-2-anti-static-convoluted-foam-ph-547101>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-flat-trash-can-lid-10-gallon-gray-ph-743151> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-flat-trash-can-lid-10-gallon-gray-ph-743151 returned 404 status code.
2025-11-01 08:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-flat-trash-can-lid-20-gal-yellow-ph-743185> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-flat-trash-can-lid-20-gal-yellow-ph-743185 returned 404 status code.
2025-11-01 08:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-11-2-mil-flat-poly-bag-ph-311984>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-fluorescent-orange-inventory-circle-labels-ph-412025>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-2-cubic-yard-domed-tilt-truck-lid-ph-749103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-2-cubic-yard-domed-tilt-truck-lid-ph-749103 returned 404 status code.
2025-11-01 08:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/12-x-8-x-20-3-mil-gusseted-poly-bag-ph-318411> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/12-x-8-x-20-3-mil-gusseted-poly-bag-ph-318411 returned 404 status code.
2025-11-01 08:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/13-3-4-x-11-black-glamour-bubble-mailer-ph-242149>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-3-4-x-1-2-fluorescent-orange-rectangle-laser-labels-ph-414165>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-12-x-12-double-wall-boxes-ph-115191>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:56 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:05:56 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:05:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 2083 pages (at 354 pages/min), scraped 860 items (at 157 items/min)
2025-11-01 08:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-1-white-rectangle-laser-labels-ph-414217>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/vinyl-safety-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-36-yds-double-sided-foam-tape-ph-652133>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-36-yds-green-solid-vinyl-safety-tape-ph-631061>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-3-4-x-1-3-8-green-13-pt-shipping-tags-pre-strung-ph-423037>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:17 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:06:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:17 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:06:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/23-5-8-x-11-1-8-x-4-yellow-shelf-bins-ph-711417>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:18 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:06:18 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:21 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/23-5-8-x-4-1-8-x-4-green-shelf-bins-ph-711385> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/23-5-8-x-4-1-8-x-4-green-shelf-bins-ph-711385 returned 404 status code.
2025-11-01 08:06:21 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/23-5-8-x-11-1-8-x-4-blue-shelf-bins-ph-711411> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/23-5-8-x-11-1-8-x-4-blue-shelf-bins-ph-711411 returned 404 status code.
2025-11-01 08:06:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24--30-lb-virgin-kraft-paper-rolls-ph-512211>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:21 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/23-5-8-x-4-1-8-x-4-clear-shelf-bins-ph-711383> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/23-5-8-x-4-1-8-x-4-clear-shelf-bins-ph-711383 returned 404 status code.
2025-11-01 08:06:21 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/23-x-33-black-can-liners-ph-751143> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/23-x-33-black-can-liners-ph-751143 returned 404 status code.
2025-11-01 08:06:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-110-yds-do-not-break-stretch-wrap-printed-box-tape-ph-617013>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:21 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/23-x-15-x-16-blue-space-age-totes-ph-716115> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/23-x-15-x-16-blue-space-age-totes-ph-716115 returned 404 status code.
2025-11-01 08:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:22 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:06:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-110-yds-if-seal-is-broken-printed-box-tape-ph-617031>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:27 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/23-5-8-x-4-1-8-x-4-yellow-shelf-bins-ph-711389> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/23-5-8-x-4-1-8-x-4-yellow-shelf-bins-ph-711389 returned 404 status code.
2025-11-01 08:06:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-110-yds-stop-if-seal-is-broken-tan-tape-ph-617079>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/carton-sealing-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-9-yellow-tubes-with-caps-ph-213337>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3.00-x-1181-black-datamax-thermal-transfer-ribbons-wax-ph-415123>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/30-250-jumbo-cable-ties-natural-ph-442023>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:41 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3.00-x-1181-black-datamax-thermal-transfer-ribbons-ph-415125> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3.00-x-1181-black-datamax-thermal-transfer-ribbons-ph-415125 returned 404 status code.
2025-11-01 08:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:42 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-8-black-premium-anti-fatigue-mat-ph-737410> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-8-black-premium-anti-fatigue-mat-ph-737410 returned 404 status code.
2025-11-01 08:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-10-black-marble-anti-fatigue-mat-ph-737138> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-10-black-marble-anti-fatigue-mat-ph-737138 returned 404 status code.
2025-11-01 08:06:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-10-hot-rush-fluorescent-orange-labels-ph-411559>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:52 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-10-charcoal-vinyl-carpet-mat-ph-737530> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-10-charcoal-vinyl-carpet-mat-ph-737530 returned 404 status code.
2025-11-01 08:06:52 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-10-charcoal-deluxe-entry-mat-ph-737455> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-10-charcoal-deluxe-entry-mat-ph-737455 returned 404 status code.
2025-11-01 08:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-110-yds-clear-800-economy-tape-ph-611113>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:56 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-10-black-economy-anti-fatigue-mat-ph-737365> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-10-black-economy-anti-fatigue-mat-ph-737365 returned 404 status code.
2025-11-01 08:06:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-60-yds-silver-9-mil-duct-tape-ph-682175>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-60-yds-yellow-11-mil-gaffers-tape-ph-693143>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-6-2-mil-minigrip-reclosable-poly-bag-ph-313131>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:00 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-6-black-premium-anti-fatigue-mat-ph-737424> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-6-black-premium-anti-fatigue-mat-ph-737424 returned 404 status code.
2025-11-01 08:07:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/carton-sealing-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:00 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-6-green-waterhog-mat-ph-737193> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-6-green-waterhog-mat-ph-737193 returned 404 status code.
2025-11-01 08:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:01 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-6-charcoal-economy-vinyl-carpet-mat-ph-737520> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-6-charcoal-economy-vinyl-carpet-mat-ph-737520 returned 404 status code.
2025-11-01 08:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:01 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:02 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-6-premium-anti-fatigue-mat-ph-737425> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-6-premium-anti-fatigue-mat-ph-737425 returned 404 status code.
2025-11-01 08:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:03 [py.warnings] (PID: 95) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2025-11-01 08:07:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-8-4-mil-poly-bag-on-a-roll-ph-314165>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:04 [scrapy.extensions.feedexport] (PID: 95) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:1
2025-11-01 08:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-9-black-inventory-rectangle-labels-ph-412559>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-8-charcoal-economy-vinyl-carpet-mat-ph-737525> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-8-charcoal-economy-vinyl-carpet-mat-ph-737525 returned 404 status code.
2025-11-01 08:07:07 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:07:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-8-green-waterhog-mat-ph-737199> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-8-green-waterhog-mat-ph-737199 returned 404 status code.
2025-11-01 08:07:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 2448 pages (at 365 pages/min), scraped 1013 items (at 153 items/min)
2025-11-01 08:07:08 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:09 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:10 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-20-medium-gray-waterhog-runner-ph-737296> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-20-medium-gray-waterhog-runner-ph-737296 returned 404 status code.
2025-11-01 08:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-2-x-8-2-mil-gusseted-poly-bag-ph-318111>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-8-white-hook-individual-tape-dots-ph-672045>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/hook-and-loop-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:27 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/safety-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:30 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:31 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:32 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:32 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-5-32-yellow-plastic-twist-ties-ph-345309>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-5-x-4-1-2-insulated-shipping-kit-ph-182103>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-60ga-x-4375-poly-olefin-shrink-film-ph-384101>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-12-open-end-static-shielding-bags-ph-334249>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-16-3-mil-flat-poly-bag-ph-311667>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/8-x-30-4-mil-reclosable-poly-bag-ph-315375> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/8-x-30-4-mil-reclosable-poly-bag-ph-315375 returned 404 status code.
2025-11-01 08:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-square-can-flat-lid-28-gal-gray-ph-743107> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-square-can-flat-lid-28-gal-gray-ph-743107 returned 404 status code.
2025-11-01 08:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-trash-can-10-gallon-black-ph-743131> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-trash-can-10-gallon-black-ph-743131 returned 404 status code.
2025-11-01 08:07:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-trash-can-20-gallon-black-ph-743159> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-trash-can-20-gallon-black-ph-743159 returned 404 status code.
2025-11-01 08:07:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-trash-can-20-gallon-blue-ph-743161> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-trash-can-20-gallon-blue-ph-743161 returned 404 status code.
2025-11-01 08:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:49 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/continuous-air-freshener-refill-mango-ph-827013> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/continuous-air-freshener-refill-mango-ph-827013 returned 404 status code.
2025-11-01 08:07:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/contractors-bag-black-40-55-gal-3-mil-ph-756105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/contractors-bag-black-40-55-gal-3-mil-ph-756105 returned 404 status code.
2025-11-01 08:07:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/continuous-air-freshener-refill-citrus-ph-827009> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/continuous-air-freshener-refill-citrus-ph-827009 returned 404 status code.
2025-11-01 08:07:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-110-yds-stop-alto-printed-box-tape-ph-617185>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/cowhide-leather-drivers-gloves-lined-l-ph-891267> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/cowhide-leather-drivers-gloves-lined-l-ph-891267 returned 404 status code.
2025-11-01 08:07:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/contractors-bag-black-56-gal-30-mil-ph-756109> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/contractors-bag-black-56-gal-30-mil-ph-756109 returned 404 status code.
2025-11-01 08:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/door-sign-conference-ph-781173> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/door-sign-conference-ph-781173 returned 404 status code.
2025-11-01 08:07:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/door-sign-office-ph-781171> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/door-sign-office-ph-781171 returned 404 status code.
2025-11-01 08:07:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/dfc-364-disposable-film-cutter-ph-732141> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/dfc-364-disposable-film-cutter-ph-732141 returned 404 status code.
2025-11-01 08:07:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/door-sign-private-ph-781187> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/door-sign-private-ph-781187 returned 404 status code.
2025-11-01 08:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/door-sign-stairs-ph-781199> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/door-sign-stairs-ph-781199 returned 404 status code.
2025-11-01 08:07:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-flat-trash-can-lid-44-gallon-gray-ph-743249> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-flat-trash-can-lid-44-gallon-gray-ph-743249 returned 404 status code.
2025-11-01 08:07:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/door-sign-women-ph-781193> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/door-sign-women-ph-781193 returned 404 status code.
2025-11-01 08:07:52 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/door-sign-restrooms-ph-781191> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/door-sign-restrooms-ph-781191 returned 404 status code.
2025-11-01 08:07:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-15-white-tubes-with-caps-ph-213411>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:52 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/e-a-rsoft-yellow-neons-earplugs-ph-725105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/e-a-rsoft-yellow-neons-earplugs-ph-725105 returned 404 status code.
2025-11-01 08:07:52 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/environsweep-100-lb-ph-842001> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/environsweep-100-lb-ph-842001 returned 404 status code.
2025-11-01 08:07:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-16-4-mil-flat-poly-bag-ph-311174>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:52 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/clear-poly-gloves-18-elbow-length-ph-891127> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/clear-poly-gloves-18-elbow-length-ph-891127 returned 404 status code.
2025-11-01 08:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:54 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/emergency-exit-only-6-x-9-facility-sign-ph-781119> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/emergency-exit-only-6-x-9-facility-sign-ph-781119 returned 404 status code.
2025-11-01 08:07:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:57 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-15-blue-marble-anti-fatigue-mat-ph-737141> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-15-blue-marble-anti-fatigue-mat-ph-737141 returned 404 status code.
2025-11-01 08:07:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-9-fluorescent-green-inventory-rectangle-labels-ph-412567>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:07:59 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-12-navy-waterhog-mat-ph-737213> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-12-navy-waterhog-mat-ph-737213 returned 404 status code.
2025-11-01 08:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:04 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:04 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-9-slip-guard-drainage-mat-ph-737151> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-9-slip-guard-drainage-mat-ph-737151 returned 404 status code.
2025-11-01 08:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/40-x-48-chipboard-pads-ph-481059>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/40-x-46-black-can-liners-ph-751171> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/40-x-46-black-can-liners-ph-751171 returned 404 status code.
2025-11-01 08:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/40-x-46-clear-can-liners-ph-751125> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/40-x-46-clear-can-liners-ph-751125 returned 404 status code.
2025-11-01 08:08:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/40-x-46-black-can-liners-ph-751167> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/40-x-46-black-can-liners-ph-751167 returned 404 status code.
2025-11-01 08:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 2805 pages (at 357 pages/min), scraped 1156 items (at 143 items/min)
2025-11-01 08:08:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/40-x-46-clear-can-liners-ph-751123> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/40-x-46-clear-can-liners-ph-751123 returned 404 status code.
2025-11-01 08:08:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/40-x-40-3-mil-flat-poly-bag-ph-312467> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/40-x-40-3-mil-flat-poly-bag-ph-312467 returned 404 status code.
2025-11-01 08:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-1-1-2-mil-flat-polypropylene-bags-ph-354161>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-20-1-mil-flat-poly-bag-ph-311397>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-24-kraft-jumbo-tubes-ph-213641>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-6-kraft-self-seal-flat-mailers-ph-231109>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-6-resealable-clear-face-document-envelopes-ph-453057>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-6-x-2-white-corrugated-mailers-ph-211255>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-6-x-6-kraft-corrugated-mailers-ph-211267>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-6-medium-gray-waterhog-mat-ph-737266> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-6-medium-gray-waterhog-mat-ph-737266 returned 404 status code.
2025-11-01 08:08:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-7-2-mil-flat-poly-bag-ph-311448>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-36-2-mil-flat-poly-bag-ph-311651>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:42 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/safety-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/ez2-concealed-blade-safety-cutter-ph-732171> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/ez2-concealed-blade-safety-cutter-ph-732171 returned 404 status code.
2025-11-01 08:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/exit-6-x-9-facility-sign-ph-781121> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/exit-6-x-9-facility-sign-ph-781121 returned 404 status code.
2025-11-01 08:08:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/fingerless-pvc-dot-knit-gloves-large-ph-891417> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/fingerless-pvc-dot-knit-gloves-large-ph-891417 returned 404 status code.
2025-11-01 08:08:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/ez3-spring-back-safety-utility-knife-ph-732133> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/ez3-spring-back-safety-utility-knife-ph-732133 returned 404 status code.
2025-11-01 08:08:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/glad-forceflex-trash-bag-13-gal-white-ph-753105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/glad-forceflex-trash-bag-13-gal-white-ph-753105 returned 404 status code.
2025-11-01 08:08:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/fire-alarm-9-x-6-facility-sign-ph-781155> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/fire-alarm-9-x-6-facility-sign-ph-781155 returned 404 status code.
2025-11-01 08:08:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/glutton-recycling-container-56-gal-blue-ph-742149> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/glutton-recycling-container-56-gal-blue-ph-742149 returned 404 status code.
2025-11-01 08:08:49 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/goatskin-leather-drivers-gloves-xlarge-ph-891281> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/goatskin-leather-drivers-gloves-xlarge-ph-891281 returned 404 status code.
2025-11-01 08:08:49 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/glad-drawstring-trash-bag-13-gal-white-ph-753101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/glad-drawstring-trash-bag-13-gal-white-ph-753101 returned 404 status code.
2025-11-01 08:08:49 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/glad-forceflex-trash-bag-30-gal-black-ph-753107> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/glad-forceflex-trash-bag-30-gal-black-ph-753107 returned 404 status code.
2025-11-01 08:08:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/kraft-000-self-seal-bubble-mailer-tear-strip-ph-241115>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/kraft-000-self-seal-bubble-mailerw-tear-strip-ph-241105>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:49 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/gojo-wall-mount-dispenser-gray-ph-822045> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/gojo-wall-mount-dispenser-gray-ph-822045 returned 404 status code.
2025-11-01 08:08:49 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-black-56-gallon-55-mil-ph-754151> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-black-56-gallon-55-mil-ph-754151 returned 404 status code.
2025-11-01 08:08:49 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-black-60-gallon-55-mil-ph-754159> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-black-60-gallon-55-mil-ph-754159 returned 404 status code.
2025-11-01 08:08:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-12-heavy-duty-moisture-barrier-bags-ph-333125>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-12-kraft-clasp-envelopes-ph-281199>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/gojo-wall-mount-dispenser-gray-ph-822043> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/gojo-wall-mount-dispenser-gray-ph-822043 returned 404 status code.
2025-11-01 08:08:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-black-60-gallon-87-mil-ph-754163> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-black-60-gallon-87-mil-ph-754163 returned 404 status code.
2025-11-01 08:08:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-natural-60-gallon-47-mil-ph-754127> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-natural-60-gallon-47-mil-ph-754127 returned 404 status code.
2025-11-01 08:08:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-natural-7-10-gallon-23-mil-ph-754101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-natural-7-10-gallon-23-mil-ph-754101 returned 404 status code.
2025-11-01 08:08:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-natural-12-15-gal-31-mil-ph-754107> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-natural-12-15-gal-31-mil-ph-754107 returned 404 status code.
2025-11-01 08:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/kimtech-wettask-prep-wipers-ph-844039> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/kimtech-wettask-prep-wipers-ph-844039 returned 404 status code.
2025-11-01 08:08:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:53 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/ice-melt-ph-843001> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/ice-melt-ph-843001 returned 404 status code.
2025-11-01 08:08:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:57 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/industrial-first-aid-kit-50-person-ph-724103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/industrial-first-aid-kit-50-person-ph-724103 returned 404 status code.
2025-11-01 08:08:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:08:59 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/handguard-ii-gloves-large-ph-891059> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/handguard-ii-gloves-large-ph-891059 returned 404 status code.
2025-11-01 08:09:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 3131 pages (at 326 pages/min), scraped 1298 items (at 142 items/min)
2025-11-01 08:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/13-x-10-x-7-corrugated-boxes-ph-101369>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/12-x-10-3-mil-flat-poly-bag-ph-311965> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/12-x-10-3-mil-flat-poly-bag-ph-311965 returned 404 status code.
2025-11-01 08:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/13-pt-steel-track-snap-utility-knife-ph-732131> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/13-pt-steel-track-snap-utility-knife-ph-732131 returned 404 status code.
2025-11-01 08:09:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-2-x-120-yds-3m-860-poly-strapping-tape-ph-643005> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-2-x-120-yds-3m-860-poly-strapping-tape-ph-643005 returned 404 status code.
2025-11-01 08:09:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/13-x-18-4-mil-flat-poly-bag-ph-311806>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/13-x-18-8-mil-reclosable-poly-bag-ph-315516>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-18-reclosable-static-shielding-bags-ph-334367>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-20-2-mil-flat-poly-bag-ph-312055>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-20-4-mil-flat-poly-bag-ph-311823>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-30-1-mil-flat-poly-bag-ph-311919>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-5-yds-3m-4462-double-sided-foam-tape-ph-652155>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-60-black-tape-logic-anti-slip-tape-ph-631015>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-60-yds-1400-strapping-tape-ph-641043>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-60-yds-3m-201+-masking-tape-ph-681559>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-60-yds-double-sided-film-tape-ph-653039 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-60-yds-double-sided-film-tape-ph-653035 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-60-yds-double-sided-film-tape-ph-653031 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/hook-and-loop-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-x-60-yds-3m-101+-masking-tape-ph-681557> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-x-60-yds-3m-101+-masking-tape-ph-681557 returned 404 status code.
2025-11-01 08:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-60-yds-double-sided-film-tape-ph-653027 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-60-yds-double-sided-film-tape-ph-653023 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-4-x-60-yds-double-sided-film-tape-ph-653019 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-60-yds-double-sided-film-tape-ph-653015 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-60-yds-double-sided-film-tape-ph-653011 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-4-x-60-yds-double-sided-film-tape-ph-653007 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:39 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:40 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:09:40 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:09:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-125-cool-shield-bubble-rolls-ph-185129>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:40 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/safety-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:09:40 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:09:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:41 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:09:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-14-x-14-double-wall-boxes-ph-115359>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:41 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-125-parcel-ready-perfed-bubble-rolls-ph-531227 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:43 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-15-x-10-deluxe-file-storage-boxes-ph-718105>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:44 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:45 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:09:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-188-parcel-ready-perfed-bubble-rolls-ph-531187 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-24-yellow-tubes-with-caps-ph-213255>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-26-white-tubes-with-caps-ph-213261>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-2-x-2-white-gift-box-ph-931103>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 3452 pages (at 321 pages/min), scraped 1426 items (at 128 items/min)
2025-11-01 08:10:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/30-x-60-black-bubble-mat-ph-737164>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-36-kraft-jumbo-tubes-ph-213709>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-12-x-1-1-4-white-literature-mailer-ph-212495>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/12-x-125-parcel-ready-perfed-bubble-rolls-ph-531203 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-12-x-125-parcel-ready-bubble-rolls-ph-531201>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-12-x-2-kraft-literature-mailers-ph-212637>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-12-x-3-kraft-literature-mailers-ph-212639>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-12-x-4-multi-depth-corrugated-boxes-ph-113175>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-12-x-4-white-deluxe-literature-mailer-ph-212191>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-12-x-6-kraft-deluxe-literature-mailer-ph-212193>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/13-x-9-x-8-corrugated-boxes-ph-101439>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-1-2-x-16-27-mil-minigrip-slider-grip-reclosable-ph-313303>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-50-red-cable-ties-ph-441203>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/17-1-4-x-11-1-4-x-5-flat-corrugated-box-ph-101793>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-blue-stack-hang-bin-ph-711227> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-blue-stack-hang-bin-ph-711227 returned 404 status code.
2025-11-01 08:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/17-7-8-x-17-7-8-corrugated-layer-pads-ph-112157>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:49 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-7-8-x-11-1-8-x-4-blue-shelf-bins-ph-711373> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-7-8-x-11-1-8-x-4-blue-shelf-bins-ph-711373 returned 404 status code.
2025-11-01 08:10:49 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-7-8-x-4-1-8-x-4-yellow-shelf-bins-ph-711351> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-7-8-x-4-1-8-x-4-yellow-shelf-bins-ph-711351 returned 404 status code.
2025-11-01 08:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-7-8-x-8-3-8-x-4-green-shelf-bins-ph-711367> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-7-8-x-8-3-8-x-4-green-shelf-bins-ph-711367 returned 404 status code.
2025-11-01 08:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-7-8-x-8-3-8-x-4-red-shelf-bins-ph-711369> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-7-8-x-8-3-8-x-4-red-shelf-bins-ph-711369 returned 404 status code.
2025-11-01 08:10:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/17-x-17-x-8-laptop-shipping-system-ph-121115>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-60-yds-3m-8919-strapping-tape-ph-642199>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:52 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-x-14-1-2-x-9-7-8-red-stack-nest-bin-ph-717117> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-x-14-1-2-x-9-7-8-red-stack-nest-bin-ph-717117 returned 404 status code.
2025-11-01 08:10:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:53 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-x-14-1-2-red-stack-nest-lids-ph-717147> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-x-14-1-2-red-stack-nest-lids-ph-717147 returned 404 status code.
2025-11-01 08:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:53 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-x-60-yds-3m-301+-masking-tape-ph-681605> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-x-60-yds-3m-301+-masking-tape-ph-681605 returned 404 status code.
2025-11-01 08:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/aluminum-foil-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:54 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-x-60-yds-3m-501+-masking-tape-ph-681609> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-x-60-yds-3m-501+-masking-tape-ph-681609 returned 404 status code.
2025-11-01 08:10:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-60-yds-sm-pk-3m-2526-flatback-tape-ph-624037>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:54 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-x-14-1-2-x-12-7-8-blue-stack-nest-bin-ph-717121> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-x-14-1-2-x-12-7-8-blue-stack-nest-bin-ph-717121 returned 404 status code.
2025-11-01 08:10:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-60-yds-yellow-11-mil-gaffers-tape-ph-693031>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:54 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-x-60-yds-3m-9485.c-adhesive-transfer-tape-ph-651061> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-x-60-yds-3m-9485.c-adhesive-transfer-tape-ph-651061 returned 404 status code.
2025-11-01 08:10:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-20-x-18-corrugated-boxes-ph-102413>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/duct-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:01 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/24-x-24-4-mil-anti-static-poly-bag-ph-331277> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/24-x-24-4-mil-anti-static-poly-bag-ph-331277 returned 404 status code.
2025-11-01 08:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:02 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:11:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-250--b-flute-kraft-singleface-ph-518119>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-2-x-36-160-edge-protectors-cased-ph-461027>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-2-mil-blue-reclosable-poly-bag-ph-315024>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:07 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:11:08 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:11:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-4-mil-flat-poly-bag-ph-311035>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-4-mil-poly-bag-on-a-roll-ph-314103>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 3772 pages (at 320 pages/min), scraped 1568 items (at 142 items/min)
2025-11-01 08:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-1-2-n-vinyl-warehouse-letter-labels-ph-417053>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-1-2-x-2-white-plastic-strap-guards-ph-463041>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-1-2-x-6-1-2-kraft-gummed-envelopes-ph-281107>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/double-sided-foam-tape-roll>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-1-4-x-1-3-4-x-3-blue-shelf-bin-cups-ph-713101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-1-4-x-1-3-4-x-3-blue-shelf-bin-cups-ph-713101 returned 404 status code.
2025-11-01 08:11:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-1-4-x-1-3-4-x-3-yellow-shelf-bin-cups-ph-713103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-1-4-x-1-3-4-x-3-yellow-shelf-bin-cups-ph-713103 returned 404 status code.
2025-11-01 08:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-1-4-x-1-5-8-yellow-13-pt-shipping-tags-pre-wired-ph-423151>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-36-yds-yellow-3-pack-solid-vinyl-safety-tape-ph-631371>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-375-kraft-central-260-reinforced-tape-ph-623003>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-flush-cut-foam-pouches-ph-542101>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-light-blue-inventory-rectangle-labels-ph-412735>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-x-48-telescoping-boxes-ph-116161>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-x-4-kraft-deluxe-literature-mailer-ph-212101>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-x-6-white-reverse-tuck-folding-cartons-ph-971311>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-5-x-18-white-square-mailing-tubes-ph-213655>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-4-green-waterhog-mat-ph-737223> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-4-green-waterhog-mat-ph-737223 returned 404 status code.
2025-11-01 08:11:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-5-x-5-corrugated-boxes-ph-103037>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-7-red-inventory-rectangle-labels-ph-412857>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-8-1-2-self-seal-bubble-pouches-ph-532161>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:11:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:11:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:01 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-8-brown-waterhog-mat-ph-737269> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-8-brown-waterhog-mat-ph-737269 returned 404 status code.
2025-11-01 08:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:05 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-9-job-ticket-holders-ph-731105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-9-job-ticket-holders-ph-731105 returned 404 status code.
2025-11-01 08:12:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-8-4-mil-minigrip-reclosable-poly-bag-ph-313229>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-8-x-11-corrugated-boxes-ph-103199>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 4087 pages (at 315 pages/min), scraped 1718 items (at 150 items/min)
2025-11-01 08:12:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-8-x-2-white-corrugated-mailers-ph-211429>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/kraft-1-heat-seal-bubble-mailers-ph-241161>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/white-block-poly-bags already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-8-4-mil-white-block-reclosable-poly-bag-ph-317317 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-10-2-mil-white-block-reclosable-poly-bag-ph-317117>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-8-2-mil-white-block-reclosable-poly-bag-ph-317315 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-6-mil-white-block-reclosable-poly-bag-ph-317313 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-minigrip-white-block-reclosable-hang-hole-ph-313169 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-4-milwhiteblockreclosable-poly-bag-ph-315050 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-2-mil-white-block-reclosable-poly-bag-ph-317307 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-3-mil-slide-seal-white-block-poly-bag-ph-317309>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-2-mil-minigrip-white-block-reclosable-poly-bag-ph-313167 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-5-2-mil-white-block-reclosable-poly-bag-ph-317125 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-4-2-mil-white-block-reclosable-poly-bag-ph-317121 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-4-mil-minigrip-white-block-reclosable-hang-holes-ph-313143 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-4-mil-white-block-reclosable-poly-bag-ph-317123>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-6-mil-white-block-reclosable-poly-bag-ph-317111 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-6-2-mil-white-block-reclosable-poly-bag-ph-317113>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-4-mil-white-block-reclosable-poly-bag-ph-317109 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-2-mil-white-block-reclosable-poly-bag-ph-317107 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-2-mil-minigrip-white-block-reclosable-poly-bag-ph-313139 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-4-4-mil-white-block-reclosable-poly-bag-ph-317105 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-4-4-mil-minigrip-white-block-reclosable-hang-hole-ph-313141 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-4-2-mil-white-block-reclosable-poly-bag-ph-317103 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-4-2-mil-minigrip-white-block-reclosable-poly-bag-ph-313137 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-2-mil-white-block-reclosable-poly-bag-ph-317303 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-1-2-x-3-4-mil-white-block-reclosable-poly-bag-ph-317277 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-6-4-mil-white-block-reclosable-poly-bag-ph-317293 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-6-2-mil-white-block-reclosable-poly-bag-ph-317291 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-4-2-mil-white-block-reclosable-poly-bag-ph-317287 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-4-mil-white-block-reclosable-poly-bag-ph-317285 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-2-mil-minigrip-white-block-reclosable-poly-bag-ph-313109 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-2-mil-white-block-reclosable-poly-bag-ph-317283 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-2-2-mil-white-block-reclosable-poly-bag-ph-317279 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-x-2-2-mil-white-block-reclosable-poly-bag-ph-317101 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/letter-legal-black-r-kive-file-storage-ph-718125>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:28 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/leather-palm-w-knit-wrist-gloves-l-ph-891307> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/leather-palm-w-knit-wrist-gloves-l-ph-891307 returned 404 status code.
2025-11-01 08:12:28 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/leather-palm-w-safety-cuff-gloves-xl-ph-891313> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/leather-palm-w-safety-cuff-gloves-xl-ph-891313 returned 404 status code.
2025-11-01 08:12:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:28 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/leather-palm-w-safety-cuff-gloves-m-ph-891309> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/leather-palm-w-safety-cuff-gloves-m-ph-891309 returned 404 status code.
2025-11-01 08:12:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:29 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/leather-palm-w-safety-cuff-gloves-l-ph-891311> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/leather-palm-w-safety-cuff-gloves-l-ph-891311 returned 404 status code.
2025-11-01 08:12:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/water-activated-tape-dispensers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/water-activated-tape-dispensers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/marshal-domed-trash-can-25-gallon-beige-ph-745103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/marshal-domed-trash-can-25-gallon-beige-ph-745103 returned 404 status code.
2025-11-01 08:12:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/men-women-accessible-ada-compliant-plastic-sign-ph-781117> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/men-women-accessible-ada-compliant-plastic-sign-ph-781117 returned 404 status code.
2025-11-01 08:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/manual-liquid-soap-dispenser-ph-821051> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/manual-liquid-soap-dispenser-ph-821051 returned 404 status code.
2025-11-01 08:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:32 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/latex-industrial-gloves-small-ph-891147> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/latex-industrial-gloves-small-ph-891147 returned 404 status code.
2025-11-01 08:12:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/12-x-13-4-mil-reclosable-poly-bag-ph-315494> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/12-x-13-4-mil-reclosable-poly-bag-ph-315494 returned 404 status code.
2025-11-01 08:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/12-x-15-1-2-poly-mailers-without-tear-strip-ph-221215> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/12-x-15-1-2-poly-mailers-without-tear-strip-ph-221215 returned 404 status code.
2025-11-01 08:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/12-x-15-job-ticket-holders-ph-731115> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/12-x-15-job-ticket-holders-ph-731115 returned 404 status code.
2025-11-01 08:12:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-11-x-6-corrugated-boxes-ph-101473>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-4-x-12-x-250-air-foam-rolls-ph-541267>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:58 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-4-x-14-trash-can-bands-ph-759103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-4-x-14-trash-can-bands-ph-759103 returned 404 status code.
2025-11-01 08:12:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/404 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-1-2-x-18-1-2-x-40-telescoping-boxes-ph-116135>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:01 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18--freezer-paper-rolls-ph-512183>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18--unbleached-butcher-paper-rolls-ph-512201>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/404 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-11-x-10-ivory-stack-hang-bins-ph-711279>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-12-x-12-multi-depth-corrugated-box-ph-113239>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-12-x-3-flat-corrugated-boxes-ph-101891>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-11-x-10-blue-stack-hang-bins-ph-711269> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-11-x-10-blue-stack-hang-bins-ph-711269 returned 404 status code.
2025-11-01 08:13:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-11-x-10-green-stack-hang-bins-ph-711273> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-11-x-10-green-stack-hang-bins-ph-711273 returned 404 status code.
2025-11-01 08:13:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 4415 pages (at 328 pages/min), scraped 1866 items (at 148 items/min)
2025-11-01 08:13:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-14-x-8-corrugated-boxes-ph-102075>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/404 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-200-2-mil-clear-poly-sheeting-ph-352189>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:19 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/404> (failed 3 times): Invalid response, retrying...
2025-11-01 08:13:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-26-3-mil-flat-poly-bag-ph-312328>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-30-kraft-jumbo-envelopes-ph-281283>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-36-double-wall-corrugated-sheets-ph-112205>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-36-white-corrugated-sheets-ph-112209>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-42-2-mil-flat-poly-bag-ph-312296>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-yds-clear-3m-764-vinyl-tape-ph-631453>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-yds-green-white-striped-vinyl-safety-tape-ph-631207>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-apr-fluorescent-orange-months-of-the-year-labels-ph-412361>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-caution-heavy-end-fluorescent-red-labels-ph-411485>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-do-not-open-with-sharp-object-fluor-red-labels-ph-411205>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-16-x-12-x-300-parcel-ready-bubble-rolls-ph-531119 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/32-x-44-4-mil-flat-poly-bag-ph-312363>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-3-4-x-1-7-8-fluor-orange-13-pt-shipping-tag-strung-ph-423169>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-4-1-4-two-up-arrows-over-black-bar-labels-ph-411719>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-18-cable-ties-natural-ph-441007>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/41-x-31-x-72-2-mil-clear-pallet-covers-ph-351117>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/42-x-11-x-6-corrugated-boxes-ph-102935>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:58 [py.warnings] (PID: 95) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2025-11-01 08:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:13:59 [scrapy.extensions.feedexport] (PID: 95) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:2
2025-11-01 08:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-52-1-1-2-mil-flat-poly-bag-ph-311292>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-60-black-yellow-striped-heavy-duty-anti-slip-tape-ph-631111>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 4751 pages (at 336 pages/min), scraped 2022 items (at 156 items/min)
2025-11-01 08:14:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-60-brown-economy-vinyl-carpet-mat-ph-737564> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-60-brown-economy-vinyl-carpet-mat-ph-737564 returned 404 status code.
2025-11-01 08:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-60-black-yellow-anti-fatigue-mat-ph-737393> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-60-black-yellow-anti-fatigue-mat-ph-737393 returned 404 status code.
2025-11-01 08:14:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-60-red-economy-vinyl-carpet-mat-ph-737567> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-60-red-economy-vinyl-carpet-mat-ph-737567 returned 404 status code.
2025-11-01 08:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-8-job-ticket-holders-ph-731103>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-9-this-side-up-arrow-labels-ph-411783>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:21 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/60-x-18-x-74-4-shelf-wire-shelving-ph-715237> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/60-x-18-x-74-4-shelf-wire-shelving-ph-715237 returned 404 status code.
2025-11-01 08:14:21 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/60-x-18-x-86-4-shelf-wire-shelving-ph-715241> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/60-x-18-x-86-4-shelf-wire-shelving-ph-715241 returned 404 status code.
2025-11-01 08:14:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:22 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/60-x-24-x-54-4-shelf-wire-shelving-ph-715245> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/60-x-24-x-54-4-shelf-wire-shelving-ph-715245 returned 404 status code.
2025-11-01 08:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:22 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/60-x-18-x-86-wire-shelving-add-on-unit-ph-715243> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/60-x-18-x-86-wire-shelving-add-on-unit-ph-715243 returned 404 status code.
2025-11-01 08:14:22 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/60-x-24-x-74-4-shelf-wire-shelving-ph-715253> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/60-x-24-x-74-4-shelf-wire-shelving-ph-715253 returned 404 status code.
2025-11-01 08:14:22 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/60-x-24-x-74-wire-shelving-add-on-unit-ph-715255> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/60-x-24-x-74-wire-shelving-add-on-unit-ph-715255 returned 404 status code.
2025-11-01 08:14:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-1-2-x-2-white-rectangle-laser-labels-ph-414661>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:22 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/60-x-36-x-63-4-shelf-wire-shelving-ph-715265> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/60-x-36-x-63-4-shelf-wire-shelving-ph-715265 returned 404 status code.
2025-11-01 08:14:23 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/60-x-24-x-86-4-shelf-wire-shelving-ph-715257> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/60-x-24-x-86-4-shelf-wire-shelving-ph-715257 returned 404 status code.
2025-11-01 08:14:23 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/60-x-24-wire-shelf-ph-715353> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/60-x-24-wire-shelf-ph-715353 returned 404 status code.
2025-11-01 08:14:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:23 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/60-x-36-x-86-wire-shelving-add-on-unit-ph-715275> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/60-x-36-x-86-wire-shelving-add-on-unit-ph-715275 returned 404 status code.
2025-11-01 08:14:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-1-8-x-4-1-2-x-13-3-4-kraft-hardware-bag-ph-924115>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:23 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/60-x-36-x-63-wire-shelving-add-on-unit-ph-715267> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/60-x-36-x-63-wire-shelving-add-on-unit-ph-715267 returned 404 status code.
2025-11-01 08:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:29 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/72-x-18-wire-shelf-ph-715361> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/72-x-18-wire-shelf-ph-715361 returned 404 status code.
2025-11-01 08:14:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/72-x-24-x-86-4-shelf-wire-shelving-ph-715305>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/72-x-250--a-flute-kraft-singleface-ph-518141>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/72-x-36-x-86-4-shelf-wire-shelving-ph-715321>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-8-x-8-white-corrugated-boxes-ph-111247>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-9-4-mil-reclosable-poly-bag-ph-315202>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/72-x-18-x-54-4-shelf-wire-shelving-ph-715277> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/72-x-18-x-54-4-shelf-wire-shelving-ph-715277 returned 404 status code.
2025-11-01 08:14:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/72-x-18-x-84-wire-shelving-add-on-unit-ph-715279> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/72-x-18-x-84-wire-shelving-add-on-unit-ph-715279 returned 404 status code.
2025-11-01 08:14:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/72-x-18-x-74-wire-shelving-add-on-unit-ph-715287> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/72-x-18-x-74-wire-shelving-add-on-unit-ph-715287 returned 404 status code.
2025-11-01 08:14:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-1-2-x-14-1-2-kraft-4-padded-mailers-ph-251145>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-1-2-x-45-long-poly-mailers-ph-221111>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:31 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/72-x-24-x-54-wire-shelving-add-on-unit-ph-715295> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/72-x-24-x-54-wire-shelving-add-on-unit-ph-715295 returned 404 status code.
2025-11-01 08:14:32 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/72-x-24-x-54-4-shelf-wire-shelving-ph-715293> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/72-x-24-x-54-4-shelf-wire-shelving-ph-715293 returned 404 status code.
2025-11-01 08:14:32 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/72-x-24-x-63-wire-shelving-add-on-unit-ph-715299> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/72-x-24-x-63-wire-shelving-add-on-unit-ph-715299 returned 404 status code.
2025-11-01 08:14:32 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/72-x-36-x-63-wire-shelving-add-on-unit-ph-715315> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/72-x-36-x-63-wire-shelving-add-on-unit-ph-715315 returned 404 status code.
2025-11-01 08:14:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-10-4-mil-flat-poly-bag-ph-311683>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:33 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/72-x-36-x-63-4-shelf-wire-shelving-ph-715313> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/72-x-36-x-63-4-shelf-wire-shelving-ph-715313 returned 404 status code.
2025-11-01 08:14:33 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-1-4-x-6-x-5-yellow-stack-hang-bins-ph-711141> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-1-4-x-6-x-5-yellow-stack-hang-bins-ph-711141 returned 404 status code.
2025-11-01 08:14:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-1-4-x-6-x-5-clear-stack-hang-bins-ph-711131> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-1-4-x-6-x-5-clear-stack-hang-bins-ph-711131 returned 404 status code.
2025-11-01 08:14:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:41 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/mesh-backed-lifting-gloves-black-x-l-ph-891327> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/mesh-backed-lifting-gloves-black-x-l-ph-891327 returned 404 status code.
2025-11-01 08:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:42 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/ms-410-scraper-knife-ph-732147> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/ms-410-scraper-knife-ph-732147 returned 404 status code.
2025-11-01 08:14:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:42 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/nitrile-glove-accelerator-free-s-ph-891033> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/nitrile-glove-accelerator-free-s-ph-891033 returned 404 status code.
2025-11-01 08:14:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/pro-fingerless-glove-s-ph-891109>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:42 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/nitrile-glove-accelerator-free-xl-ph-891039> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/nitrile-glove-accelerator-free-xl-ph-891039 returned 404 status code.
2025-11-01 08:14:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/nitrile-gloves-exam-grade-xlarge-ph-891179> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/nitrile-gloves-exam-grade-xlarge-ph-891179 returned 404 status code.
2025-11-01 08:14:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/nitrile-gloves-with-beaded-cuff-large-ph-891223> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/nitrile-gloves-with-beaded-cuff-large-ph-891223 returned 404 status code.
2025-11-01 08:14:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/nitrile-gloves-4-mil-small-ph-891181> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/nitrile-gloves-4-mil-small-ph-891181 returned 404 status code.
2025-11-01 08:14:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/orange-sharpie-fine-point-markers-ph-734125> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/orange-sharpie-fine-point-markers-ph-734125 returned 404 status code.
2025-11-01 08:14:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/nitrile-gloves-with-extended-cuffs-m-ph-891215> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/nitrile-gloves-with-extended-cuffs-m-ph-891215 returned 404 status code.
2025-11-01 08:14:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/nitrile-gloves-with-beaded-cuff-medium-ph-891221> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/nitrile-gloves-with-beaded-cuff-medium-ph-891221 returned 404 status code.
2025-11-01 08:14:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/pro-fingerless-glove-w-wrist-strap-m-ph-891119> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/pro-fingerless-glove-w-wrist-strap-m-ph-891119 returned 404 status code.
2025-11-01 08:14:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/qbd-379-quickblade-blade-dispenser-ph-732203> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/qbd-379-quickblade-blade-dispenser-ph-732203 returned 404 status code.
2025-11-01 08:14:45 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/quickblade-retractable-utility-knife-ph-732101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/quickblade-retractable-utility-knife-ph-732101 returned 404 status code.
2025-11-01 08:14:45 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/no-admittance-6-x-9-facility-sign-ph-781137> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/no-admittance-6-x-9-facility-sign-ph-781137 returned 404 status code.
2025-11-01 08:14:45 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/rsc-432-disposable-safety-cutter-ph-732129> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/rsc-432-disposable-safety-cutter-ph-732129 returned 404 status code.
2025-11-01 08:14:45 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/ranger-trash-can-45-gallon-4-way-black-ph-748103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/ranger-trash-can-45-gallon-4-way-black-ph-748103 returned 404 status code.
2025-11-01 08:14:45 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/rubbermaid-slim-jim-trainable-trolley-ph-742163> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/rubbermaid-slim-jim-trainable-trolley-ph-742163 returned 404 status code.
2025-11-01 08:14:45 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/qbd-324-quickblade-blade-dispenser-ph-732205> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/qbd-324-quickblade-blade-dispenser-ph-732205 returned 404 status code.
2025-11-01 08:14:45 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/pvc-black-dot-knit-gloves-small-ph-891403> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/pvc-black-dot-knit-gloves-small-ph-891403 returned 404 status code.
2025-11-01 08:14:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1-2-light-blue-inventory-circle-labels-ph-412253>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/original-keybak-retractable-key-holder-ph-739105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/original-keybak-retractable-key-holder-ph-739105 returned 404 status code.
2025-11-01 08:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-18-2-mil-anti-static-reclosable-poly-bag-ph-331205>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/12-x-188-parcel-ready-perfed-bubble-rolls-ph-531173 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:14:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-18-open-end-static-shielding-bags-ph-334349>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-4-x-17-trash-can-bands-ph-759105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-4-x-17-trash-can-bands-ph-759105 returned 404 status code.
2025-11-01 08:15:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/12-x-20-6-mil-reclosable-poly-bag-ph-315498> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/12-x-20-6-mil-reclosable-poly-bag-ph-315498 returned 404 status code.
2025-11-01 08:15:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-20-1-mil-flat-suffocation-warning-poly-bag-ph-335199>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 5112 pages (at 361 pages/min), scraped 2174 items (at 152 items/min)
2025-11-01 08:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-16-1-2-x-11-clear-stack-hang-bin-ph-711285>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:16 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-13-x-6-white-space-age-totes-ph-716101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-13-x-6-white-space-age-totes-ph-716101 returned 404 status code.
2025-11-01 08:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:17 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-16-1-2-x-11-red-stack-hang-bins-ph-711291> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-16-1-2-x-11-red-stack-hang-bins-ph-711291 returned 404 status code.
2025-11-01 08:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:17 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-16-1-2-x-11-ivory-stack-hang-bin-ph-711293> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-16-1-2-x-11-ivory-stack-hang-bin-ph-711293 returned 404 status code.
2025-11-01 08:15:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-20-6-mil-flat-poly-bag-ph-312305>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-20-x-12-double-wall-box--hand-holes-ph-115315>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-20-x-20-white-corrugated-boxes-ph-111147>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/product-cushioning>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-5-8-x-1-fluorescent-orange-rectangle-laser-labels-ph-414283>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-5-8-x-1-fluor-orange-removable-laser-labels-ph-414285>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-5-8-x-1-fluor-pink-removable-rectangle-laser-labels-ph-414293>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/25-pk-bubble-lined-poly-mailers-ph-243149>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/26-x-18-x-10-corrugated-boxes-ph-102567>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/26-x-2150-2-mil-poly-tubing-ph-353373>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/26-x-26-corrugated-sheets-ph-112219>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-invoice-enclosed-fluorescent-yellow-labels-ph-411043>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-may-fluorescent-green-months-of-the-year-labels-ph-412365>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/26-5-8-x-18-1-4-x-14-7-8-gray-stack-nest-bin-ph-717137> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/26-5-8-x-18-1-4-x-14-7-8-gray-stack-nest-bin-ph-717137 returned 404 status code.
2025-11-01 08:15:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-premium-anti-fatigue-mat-ph-737160>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-3-4-x-1-7-8-tyvek-shipping-tags-pre-wired-ph-424067>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/duct-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:53 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-4-4-mil-white-block-reclosable-poly-bag-ph-317289> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-4-4-mil-white-block-reclosable-poly-bag-ph-317289 returned 404 status code.
2025-11-01 08:15:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-1-mil-kapton-discs-ph-695019>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-circles-white-removable-labels-ph-412039>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/33-x-40-Clear-Can-Liners-PH-751119 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:55 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/33-x-40-black-can-liners-ph-751165> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/33-x-40-black-can-liners-ph-751165 returned 404 status code.
2025-11-01 08:15:55 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/33-x-40-black-can-liners-ph-751155> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/33-x-40-black-can-liners-ph-751155 returned 404 status code.
2025-11-01 08:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:59 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/33-x-40-Clear-Can-Liners-PH-751119> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/33-x-40-Clear-Can-Liners-PH-751119 returned 404 status code.
2025-11-01 08:15:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:15:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-66-10-pack-3m-33-electrical-tape-ph-683021>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-75-black-velcro-self-grip-straps-ph-673015>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-250-black-uv-cable-ties-ph-443147>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-x-12-x-63-wire-shelving-add-on-unit-ph-715113>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 5423 pages (at 311 pages/min), scraped 2317 items (at 143 items/min)
2025-11-01 08:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:09 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:16:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-12-x-54-wire-shelving-add-on-unit-ph-715105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-12-x-54-wire-shelving-add-on-unit-ph-715105 returned 404 status code.
2025-11-01 08:16:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:13 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:14 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:15 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:16:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-4-premium-anti-fatigue-mat-ph-737421> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-4-premium-anti-fatigue-mat-ph-737421 returned 404 status code.
2025-11-01 08:16:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:16 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:16:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-caution-top-heavy-arrow-labels-ph-411763>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-do-not-freeze-labels-ph-411909>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-do-not-stack-labels-ph-411911>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:32 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-6-brown-waterhog-elite-mat-ph-737402> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-6-brown-waterhog-elite-mat-ph-737402 returned 404 status code.
2025-11-01 08:16:32 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-6-black-premium-anti-fatigue-mat-ph-737440> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-6-black-premium-anti-fatigue-mat-ph-737440 returned 404 status code.
2025-11-01 08:16:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-minigrip-white-block-reclosable-hang-hole-ph-313169>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:34 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-6-charcoal-waterhog-mat-ph-737234> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-6-charcoal-waterhog-mat-ph-737234 returned 404 status code.
2025-11-01 08:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-1-4-x-3-1-8-1000-1499-tag-2-part-carbon-style-wired-ph-425105>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-x-10-1-1-2-mil-flat-polypropylene-bags-ph-354291>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-clear-stack-hang-bin-ph-711117> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-clear-stack-hang-bin-ph-711117 returned 404 status code.
2025-11-01 08:16:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-ivory-stack-hang-bin-ph-711125> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-ivory-stack-hang-bin-ph-711125 returned 404 status code.
2025-11-01 08:16:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/74-chrome-poles-4-pack-ph-715383> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/74-chrome-poles-4-pack-ph-715383 returned 404 status code.
2025-11-01 08:16:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-black-stack-hang-bin-ph-711121> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-black-stack-hang-bin-ph-711121 returned 404 status code.
2025-11-01 08:16:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:16:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:00 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-x-12-neon-blue-job-ticket-holders-ph-731121> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-x-12-neon-blue-job-ticket-holders-ph-731121 returned 404 status code.
2025-11-01 08:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:01 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-x-12-neon-job-ticket-holders-pack-ph-731143> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-x-12-neon-job-ticket-holders-pack-ph-731143 returned 404 status code.
2025-11-01 08:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:01 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-x-12-red-deluxe-job-ticket-holders-ph-731151> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-x-12-red-deluxe-job-ticket-holders-ph-731151 returned 404 status code.
2025-11-01 08:17:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:04 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-x-12-x-1-gusseted-job-ticket-holders-ph-731147> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-x-12-x-1-gusseted-job-ticket-holders-ph-731147 returned 404 status code.
2025-11-01 08:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/smoke-free-facility-6-x-9-facility-sign-ph-781133>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:05 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/scott-essential-coreless-toliet-tissue-ph-821021> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/scott-essential-coreless-toliet-tissue-ph-821021 returned 404 status code.
2025-11-01 08:17:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-black-33-gal-ph-755113> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-black-33-gal-ph-755113 returned 404 status code.
2025-11-01 08:17:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/safety-cutter-utility-knife-right-handed-ph-732121> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/safety-cutter-utility-knife-right-handed-ph-732121 returned 404 status code.
2025-11-01 08:17:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-black-56-gal-ph-755131> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-black-56-gal-ph-755131 returned 404 status code.
2025-11-01 08:17:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-black-6-bushel-ph-755135> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-black-6-bushel-ph-755135 returned 404 status code.
2025-11-01 08:17:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/single-toliet-tissue-dispenser-black-ph-821031> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/single-toliet-tissue-dispenser-black-ph-821031 returned 404 status code.
2025-11-01 08:17:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-black-6-bushel-ph-755139> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-black-6-bushel-ph-755139 returned 404 status code.
2025-11-01 08:17:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/scott-2-ply-coreless-bathroom-tissue-ph-821019> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/scott-2-ply-coreless-bathroom-tissue-ph-821019 returned 404 status code.
2025-11-01 08:17:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/skb-21-8-pt-snap-blades-ph-732189> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/skb-21-8-pt-snap-blades-ph-732189 returned 404 status code.
2025-11-01 08:17:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-black-56-gal-ph-755133> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-black-56-gal-ph-755133 returned 404 status code.
2025-11-01 08:17:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-black-40-45-gal-ph-755117> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-black-40-45-gal-ph-755117 returned 404 status code.
2025-11-01 08:17:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1-2-x-4-fragile-delicate-instruments-labels-ph-411689>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/spinner-retractable-key-holder-ph-739109> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/spinner-retractable-key-holder-ph-739109 returned 404 status code.
2025-11-01 08:17:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/square-recycling-container-35-gal-blue-ph-742145> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/square-recycling-container-35-gal-blue-ph-742145 returned 404 status code.
2025-11-01 08:17:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/stop-authorized-personnel-9-x-6-facility-sign-ph-781159> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/stop-authorized-personnel-9-x-6-facility-sign-ph-781159 returned 404 status code.
2025-11-01 08:17:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/slim-jim-swing-top-lid-23-gallon-blue-ph-742177> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/slim-jim-swing-top-lid-23-gallon-blue-ph-742177 returned 404 status code.
2025-11-01 08:17:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/sweeping-compound-100-lb-bag-ph-842009> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/sweeping-compound-100-lb-bag-ph-842009 returned 404 status code.
2025-11-01 08:17:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 5773 pages (at 350 pages/min), scraped 2469 items (at 152 items/min)
2025-11-01 08:17:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/swing-top-sanitary-napkin-receptacle-ph-825007> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/swing-top-sanitary-napkin-receptacle-ph-825007 returned 404 status code.
2025-11-01 08:17:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/sweeping-compound-300-lb-drum-ph-842011> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/sweeping-compound-300-lb-drum-ph-842011 returned 404 status code.
2025-11-01 08:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-clear-20-30-gal-ph-755151> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-clear-20-30-gal-ph-755151 returned 404 status code.
2025-11-01 08:17:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/telephone-9-x-6-facility-sign-ph-781167> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/telephone-9-x-6-facility-sign-ph-781167 returned 404 status code.
2025-11-01 08:17:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/string-knit-cotton-gloves-large-ph-891421> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/string-knit-cotton-gloves-large-ph-891421 returned 404 status code.
2025-11-01 08:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-1-2-x-60-yds-3m-101+-masking-tape-ph-681639> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-1-2-x-60-yds-3m-101+-masking-tape-ph-681639 returned 404 status code.
2025-11-01 08:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-1-2-x-60-yds-3m-101+-masking-tape-ph-681635> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-1-2-x-60-yds-3m-101+-masking-tape-ph-681635 returned 404 status code.
2025-11-01 08:17:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1-4-x-025-gauge-high-tensile-steel-strapping-ph-471087>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/slim-jim-swing-top-lid-23-gallon-black-ph-742175> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/slim-jim-swing-top-lid-23-gallon-black-ph-742175 returned 404 status code.
2025-11-01 08:17:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:19 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:17:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:20 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:21 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-48-x-125-parcel-ready-bubble-roll-ph-531245 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-6-x-4-long-corrugated-boxes-ph-101545>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-8-x-6-multi-depth-corrugated-boxes-ph-113207>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:24 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/15--60-lb-kraft-paper-rolls-ph-511119>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-5-8-fluorescent-green-circle-laser-labels-ph-414185>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-20-2-mil-white-block-reclosable-poly-bag-ph-317267>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-20-6-mil-reclosable-poly-bag-ph-315603>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:28 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/15-3-4-x-7-3-4-stack-hang-dividers-ph-712119> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/15-3-4-x-7-3-4-stack-hang-dividers-ph-712119 returned 404 status code.
2025-11-01 08:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-19-wall-mounted-panel-rack-ph-714103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-19-wall-mounted-panel-rack-ph-714103 returned 404 status code.
2025-11-01 08:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:31 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-22-3-mil-flat-poly-bag-ph-311959> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-22-3-mil-flat-poly-bag-ph-311959 returned 404 status code.
2025-11-01 08:17:31 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:17:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:32 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:17:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-8-x-24-x-350-parcel-ready-air-foam-roll-ph-541231 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:40 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 08:17:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/21-120-black-uv-cable-ties-ph-443119>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-1-2-x-1075-4-mil-poly-tubing-ph-353123>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:44 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 08:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/26-x-4-x-42-2-mil-gusseted-poly-bag-ph-318607>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 08:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:53 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/28-x-18-x-15-gray-brute-totes-with-lid-ph-717167> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/28-x-18-x-15-gray-brute-totes-with-lid-ph-717167 returned 404 status code.
2025-11-01 08:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:57 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/28-x-18-x-15-white-brute-totes-w-lid-ph-717169> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/28-x-18-x-15-white-brute-totes-w-lid-ph-717169 returned 404 status code.
2025-11-01 08:17:57 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/28-x-18-x-11-white-brute-totes-w-lid-ph-717165> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/28-x-18-x-11-white-brute-totes-w-lid-ph-717165 returned 404 status code.
2025-11-01 08:17:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-55-yds-clear-350-industrial-tape-ph-612145>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:17:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:01 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-55-yds-do-not-break-stretch-wrap-printed-box-tape-ph-617095>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:07 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:18:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/carton-sealing-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 6152 pages (at 379 pages/min), scraped 2620 items (at 151 items/min)
2025-11-01 08:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:08 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/34-x-34-x-34-corrugated-boxes-ph-102819>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-36-yds-3m-4008-double-sided-foam-tape-ph-652013>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/hook-and-loop-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-36-yds-3m-976-adhesive-transfer-tape-ph-651339>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:11 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:12 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-x-24-x-24-corrugated-boxes-ph-102871>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:13 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:18:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-x-2900-1-1-2-mil-poly-tubing-ph-353409>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-18-x-63-4-shelf-wire-shelving-ph-715141> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-18-x-63-4-shelf-wire-shelving-ph-715141 returned 404 status code.
2025-11-01 08:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:16 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-24-x-63-wire-shelving-add-on-unit-ph-715171> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-24-x-63-wire-shelving-add-on-unit-ph-715171 returned 404 status code.
2025-11-01 08:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:17 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-24-x-54-4-shelf-wire-shelving-ph-715165> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-24-x-54-4-shelf-wire-shelving-ph-715165 returned 404 status code.
2025-11-01 08:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:18 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-18-x-74-wire-shelving-add-on-unit-ph-715153> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-18-x-74-wire-shelving-add-on-unit-ph-715153 returned 404 status code.
2025-11-01 08:18:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-x-36-x-36-triple-wall-boxes-ph-115493>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-6-mil-reclosable-poly-bag-ph-315173>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:26 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-do-not-stack-labels-ph-411583>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/46-x-8-x-30-flat-panel-tv-box-ph-114991>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:29 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-5-charcoal-deluxe-vinyl-carpet-mat-ph-737465> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-5-charcoal-deluxe-vinyl-carpet-mat-ph-737465 returned 404 status code.
2025-11-01 08:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/48-x-200-hard-surface-countertop-protection-tape-ph-637019>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:33 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/48-x-188-parcel-ready-perfed-bubble-roll-ph-531195 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/48-x-40-x-24-double-wall-gaylord-bottom-ph-131161>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/48-x-40-x-24-triple-wall-boxes-ph-115525>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:33 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:34 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-18-x-63-wire-shelving-add-on-unit-ph-715203> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-18-x-63-wire-shelving-add-on-unit-ph-715203 returned 404 status code.
2025-11-01 08:18:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-18-wire-shelves-ph-715343> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-18-wire-shelves-ph-715343 returned 404 status code.
2025-11-01 08:18:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-24-x-54-4-shelf-wire-shelving-ph-715213> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-24-x-54-4-shelf-wire-shelving-ph-715213 returned 404 status code.
2025-11-01 08:18:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-18-x-74-4-shelf-wire-shelving-ph-715205> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-18-x-74-4-shelf-wire-shelving-ph-715205 returned 404 status code.
2025-11-01 08:18:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:36 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:39 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-8-charcoal-economy-vinyl-carpet-mat-ph-737555> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-8-charcoal-economy-vinyl-carpet-mat-ph-737555 returned 404 status code.
2025-11-01 08:18:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-1-2-x-10-cert-of-compliance-of-analysis-enclosed-ph-459001>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-1-2-x-10-orange-packing-list-enclosed-envelopes-ph-451033>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-1-2-x-10-red-documents-enclosed-envelopes-ph-455019>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-1-2-x-10-yellow-packing-list-enclosed-envelopes-ph-451037>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-1-4-x-3-1-8-4500-4999-tag-2-part-carbon-style-wired-ph-425223>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-1-4-x-3-1-8-4500-4999-tags-2-part-carbon-style-ph-425225>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-1-4-x-3-1-8-fluor-orange-13-pt-shipping-tag-strung-ph-423583>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-x-5-x-4-corrugated-boxes-ph-103133>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:18:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:02 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/twin-toliet-tissue-dispenser-steel-ph-821037> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/twin-toliet-tissue-dispenser-steel-ph-821037 returned 404 status code.
2025-11-01 08:19:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/white-1-self-seal-padded-mailer-ph-251121>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:03 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/urinal-flat-screen-ph-826005> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/urinal-flat-screen-ph-826005 returned 404 status code.
2025-11-01 08:19:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/white-25-pk-1-self-seal-padded-mailer-ph-251123>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/white-25-pk-2-self-seal-padded-mailer-ph-251133>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:04 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/vinyl-gloves-3-mil-powder-free-xl-ph-891361> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/vinyl-gloves-3-mil-powder-free-xl-ph-891361 returned 404 status code.
2025-11-01 08:19:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/white-5-self-seal-padded-mailer-ph-251161>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:04 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-l-ph-891391> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-l-ph-891391 returned 404 status code.
2025-11-01 08:19:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/wypall-l30-economy-wipers-bulk-pack-ph-843009>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:04 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/vinyl-gloves-5-mil-powdered-xl-ph-891369> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/vinyl-gloves-5-mil-powdered-xl-ph-891369 returned 404 status code.
2025-11-01 08:19:05 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wall-mountable-sanitary-napkin-receptacle-ph-825001> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wall-mountable-sanitary-napkin-receptacle-ph-825001 returned 404 status code.
2025-11-01 08:19:05 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wet-floor-safety-pop-up-cone-3-sided-ph-836003> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wet-floor-safety-pop-up-cone-3-sided-ph-836003 returned 404 status code.
2025-11-01 08:19:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-50-black-uv-cable-ties-ph-443075>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 6511 pages (at 359 pages/min), scraped 2771 items (at 151 items/min)
2025-11-01 08:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/white-spring-back-pocket-safety-cutter-ph-732187> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/white-spring-back-pocket-safety-cutter-ph-732187 returned 404 status code.
2025-11-01 08:19:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wypall-l40-108-x-10-all-purpose-wipers-ph-843023> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wypall-l40-108-x-10-all-purpose-wipers-ph-843023 returned 404 status code.
2025-11-01 08:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wypall-l-40-all-purpose-wipers-bulk-pack-ph-843021> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wypall-l-40-all-purpose-wipers-bulk-pack-ph-843021 returned 404 status code.
2025-11-01 08:19:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wypall-x60-125-x-168-wipers-dispenser-ph-844005> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wypall-x60-125-x-168-wipers-dispenser-ph-844005 returned 404 status code.
2025-11-01 08:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/404 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wypall-waterless-cleaning-wipes-ph-843003> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wypall-waterless-cleaning-wipes-ph-843003 returned 404 status code.
2025-11-01 08:19:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/vinyl-gloves-3-mil-powdered-xl-ph-891353> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/vinyl-gloves-3-mil-powdered-xl-ph-891353 returned 404 status code.
2025-11-01 08:19:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wypall-x60-industrial-jumbo-roll-wipers-ph-844007> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wypall-x60-industrial-jumbo-roll-wipers-ph-844007 returned 404 status code.
2025-11-01 08:19:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industry-update-september-2021 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/tour-guard-v-protective-eyewear-ph-722101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/tour-guard-v-protective-eyewear-ph-722101 returned 404 status code.
2025-11-01 08:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-16-x-72-x-1250-air-foam-roll-ph-541171>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1ith2-plastic-end-caps-ph-213803>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-2-3-4-x-4-blue-shelf-bins-ph-711297> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-2-3-4-x-4-blue-shelf-bins-ph-711297 returned 404 status code.
2025-11-01 08:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:13 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-4-1-8-x-4-clear-shelf-bins-ph-711313> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-4-1-8-x-4-clear-shelf-bins-ph-711313 returned 404 status code.
2025-11-01 08:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-16-x-12-x-900-parcel-ready-air-foam-roll-ph-541135 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/404 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-16-x-24-x-900-parcel-ready-air-foam-roll-ph-541155 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wypall-x80-125-x-168-heavy-duty-wipers-ph-843055> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wypall-x80-125-x-168-heavy-duty-wipers-ph-843055 returned 404 status code.
2025-11-01 08:19:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-11-1-8-x-4-red-shelf-bins-ph-711339> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-11-1-8-x-4-red-shelf-bins-ph-711339 returned 404 status code.
2025-11-01 08:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industry-update-september-2021 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/404 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-5-yds-white-3m-4951-vhb-tape-ph-696051>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:20 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industry-update-september-2021> (failed 3 times): Invalid response, retrying...
2025-11-01 08:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:20 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/404> (failed 3 times): Invalid response, retrying...
2025-11-01 08:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-60-yds-3m-465-adhesive-transfer-tape-hand-rolls-ph-651161>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-60-yds-3m-468mp-adhesive-transfer-tape-ph-651235>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-60-yds-3m-897-strapping-tape-ph-642021>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/15-x-1075-4-mil-anti-static-poly-tubing-ph-353297>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:25 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-2-x-60-yds-3m-860-poly-strapping-tape-ph-643013> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-2-x-60-yds-3m-860-poly-strapping-tape-ph-643013 returned 404 status code.
2025-11-01 08:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/15-x-12-x-12-multi-depth-corrugated-box-ph-113213>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:26 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:31 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:19:31 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/safety-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:19:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/strapping-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:32 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:19:33 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:19:33 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:34 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:40 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:42 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-8-1-4-x-9-blue-stack-hang-bins-ph-711255> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-8-1-4-x-9-blue-stack-hang-bins-ph-711255 returned 404 status code.
2025-11-01 08:19:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-1-2-x-2-1-2-x-30-120-edge-protectors-skid-lot-ph-462059>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-8-1-4-x-9-red-stack-hang-bins-ph-711263> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-8-1-4-x-9-red-stack-hang-bins-ph-711263 returned 404 status code.
2025-11-01 08:19:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/21-x-15-x-15-corrugated-boxes-ph-102191>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 08:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-circle-fluorescent-orange-removable-labels-ph-412093>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-clear-circle-mailing-labels-ph-414119>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:19:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 6839 pages (at 328 pages/min), scraped 2898 items (at 127 items/min)
2025-11-01 08:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-60-black-tape-logic-anti-slip-tape-ph-631057>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-60-kraft-tubes-with-caps-ph-213319>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:19 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-60-black-economy-anti-fatigue-mat-ph-737347> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-60-black-economy-anti-fatigue-mat-ph-737347 returned 404 status code.
2025-11-01 08:20:19 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-60-gray-economy-anti-fatigue-mat-ph-737349> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-60-gray-economy-anti-fatigue-mat-ph-737349 returned 404 status code.
2025-11-01 08:20:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-60-yds-3m-2364-masking-tape-ph-681741>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:20 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-60-yds-3m-101+-masking-tape-ph-681705> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-60-yds-3m-101+-masking-tape-ph-681705 returned 404 status code.
2025-11-01 08:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-36-yds-red-3-pack-3m-471-vinyl-tape-ph-631217>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-5-yds-clear-3m-4905-vhb-tape-ph-696069>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:23 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-60-yds-3m-2460-flatback-tape-ph-624069> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-60-yds-3m-2460-flatback-tape-ph-624069 returned 404 status code.
2025-11-01 08:20:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-60-yds-1550-strapping-tape-ph-641023>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-60-yds-2600-masking-tape-ph-681301>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:24 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-60-yds-3m-2515-flatback-tape-ph-624081> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-60-yds-3m-2515-flatback-tape-ph-624081 returned 404 status code.
2025-11-01 08:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:25 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-55-yds-tan-400-industrial-tape-ph-612183> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-55-yds-tan-400-industrial-tape-ph-612183 returned 404 status code.
2025-11-01 08:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:27 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:20:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:28 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-x-48-1-1-2-mil-flat-poly-bag-ph-312388>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:29 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:20:29 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:20:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-4-x-60-yds-3m-301+-masking-tape-ph-681447> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-4-x-60-yds-3m-301+-masking-tape-ph-681447 returned 404 status code.
2025-11-01 08:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-4-x-60-yds-3m-501+-masking-tape-ph-681343> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-4-x-60-yds-3m-501+-masking-tape-ph-681343 returned 404 status code.
2025-11-01 08:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:30 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:32 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:20:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:32 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:20:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:32 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-58-clear-can-liners-ph-751133> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-58-clear-can-liners-ph-751133 returned 404 status code.
2025-11-01 08:20:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:34 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-58-black-can-liners-ph-751183> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-58-black-can-liners-ph-751183 returned 404 status code.
2025-11-01 08:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:35 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:20:35 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:36 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-fragile-do-not-drop-fluorescent-yellow-labels-ph-411103>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-fragile-fluorescent-red-labels-ph-411793>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:38 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:20:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:38 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-kraft-block-out-labels-ph-412019>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:40 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:20:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-no-romper-la-envoltura-de-plastico-bilingual-label-ph-411193>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/48-x-48--butcher-paper-sheets-ph-512133>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/48-x-750-perfed-anti-static-bubble-ph-531165>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/48-x-96-corrugated-sheets-ph-112329>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:20:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/49-1-4-x-24-1-4-x-4-gaylord-lids-ph-131155>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-1-4-x-2-5-8-blue-tyvek-shipping-tag-ph-424125>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:04 [py.warnings] (PID: 95) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2025-11-01 08:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:04 [scrapy.extensions.feedexport] (PID: 95) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:3
2025-11-01 08:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-1-8-x-2-3-4-x-3-yellow-shelf-bin-cups-ph-713107> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-1-8-x-2-3-4-x-3-yellow-shelf-bin-cups-ph-713107 returned 404 status code.
2025-11-01 08:21:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 7139 pages (at 300 pages/min), scraped 3014 items (at 116 items/min)
2025-11-01 08:21:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-1-4-x-3-plastic-shelf-bin-dividers-ph-712127> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-1-4-x-3-plastic-shelf-bin-dividers-ph-712127 returned 404 status code.
2025-11-01 08:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/63-chrome-poles-4-pack-ph-715379> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/63-chrome-poles-4-pack-ph-715379 returned 404 status code.
2025-11-01 08:21:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:16 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-shelf-wire-shelving-with-blue-bins-ph-715119> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-shelf-wire-shelving-with-blue-bins-ph-715119 returned 404 status code.
2025-11-01 08:21:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:17 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-100ga-2625-poly-olefin-shrink-film-ph-384109> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-100ga-2625-poly-olefin-shrink-film-ph-384109 returned 404 status code.
2025-11-01 08:21:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-1-2-x-11-weather-resistant-laser-labels-ph-414697>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:21:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:19 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-10-medium-gray-waterhog-mat-ph-737278> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-10-medium-gray-waterhog-mat-ph-737278 returned 404 status code.
2025-11-01 08:21:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:21:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-1-2-x-33-long-poly-mailers-ph-221107>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:20 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-10-charcoal-waterhog-mat-ph-737276> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-10-charcoal-waterhog-mat-ph-737276 returned 404 status code.
2025-11-01 08:21:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:21:20 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/8-1-2-x-11-solid-back-job-ticket-holder-ph-731137> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/8-1-2-x-11-solid-back-job-ticket-holder-ph-731137 returned 404 status code.
2025-11-01 08:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-40-fluorescent-pink-cable-ties-ph-441101>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:21:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-20-1-mil-flat-poly-bag-ph-311704>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-3-4-x-13-blue-metallic-glamour-mailer-ph-242243>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/404 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:41 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-1-8-x-4-3-4-stack-hang-dividers-ph-712109> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-1-8-x-4-3-4-stack-hang-dividers-ph-712109 returned 404 status code.
2025-11-01 08:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:42 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-blue-stack-hang-bin-ph-711143> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-blue-stack-hang-bin-ph-711143 returned 404 status code.
2025-11-01 08:21:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:42 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-7-8-x-11-x-5-ivory-stack-hang-bins-ph-711195> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-7-8-x-11-x-5-ivory-stack-hang-bins-ph-711195 returned 404 status code.
2025-11-01 08:21:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-7-8-x-11-x-5-blue-stack-hang-bins-ph-711185> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-7-8-x-11-x-5-blue-stack-hang-bins-ph-711185 returned 404 status code.
2025-11-01 08:21:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-black-stack-hang-bin-ph-711163> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-black-stack-hang-bin-ph-711163 returned 404 status code.
2025-11-01 08:21:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-green-stack-hang-bin-ph-711161> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-green-stack-hang-bin-ph-711161 returned 404 status code.
2025-11-01 08:21:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-ivory-stack-hang-bin-ph-711167> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-ivory-stack-hang-bin-ph-711167 returned 404 status code.
2025-11-01 08:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/404 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-yellow-stack-hang-bin-ph-711169> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-yellow-stack-hang-bin-ph-711169 returned 404 status code.
2025-11-01 08:21:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-x-20-2-mil-flat-poly-bag-ph-311764>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-ivory-stack-hang-bin-ph-711181> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-ivory-stack-hang-bin-ph-711181 returned 404 status code.
2025-11-01 08:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-blue-stack-hang-bin-ph-711171> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-blue-stack-hang-bin-ph-711171 returned 404 status code.
2025-11-01 08:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-x-8-x-8-corrugated-boxes-ph-101171>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/404 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-x-17-job-ticket-holders-ph-731113> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-x-17-job-ticket-holders-ph-731113 returned 404 status code.
2025-11-01 08:21:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/404> (failed 3 times): Invalid response, retrying...
2025-11-01 08:21:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:21:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:21:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-60-yds-3m-9502-adhesive-transfer-tape-ph-651243>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:53 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-x-8-1-2-job-ticket-holders-ph-731133> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-x-8-1-2-job-ticket-holders-ph-731133 returned 404 status code.
2025-11-01 08:21:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-75-black-hook-individual-tape-strips-ph-673055>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:21:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-double-sided-film-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:08 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 7485 pages (at 346 pages/min), scraped 3165 items (at 151 items/min)
2025-11-01 08:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-1075-4-mil-anti-static-poly-tubing-ph-353309>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-10-x-10-corrugated-boxes-ph-101653>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:10 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:22:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/16-x-10-blue-stack-nest-lids-ph-717139> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/16-x-10-blue-stack-nest-lids-ph-717139 returned 404 status code.
2025-11-01 08:22:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/16-x-10-gray-stack-nest-lids-ph-717143> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/16-x-10-gray-stack-nest-lids-ph-717143 returned 404 status code.
2025-11-01 08:22:12 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:22:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:13 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/16-x-10-red-stack-nest-lids-ph-717141> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/16-x-10-red-stack-nest-lids-ph-717141 returned 404 status code.
2025-11-01 08:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:13 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:22:13 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/16-x-10-x-8-7-8-blue-stack-nest-bin-ph-717109> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/16-x-10-x-8-7-8-blue-stack-nest-bin-ph-717109 returned 404 status code.
2025-11-01 08:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/16-x-10-x-8-7-8-gray-stack-nest-bin-ph-717113> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/16-x-10-x-8-7-8-gray-stack-nest-bin-ph-717113 returned 404 status code.
2025-11-01 08:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-quart-paint-can-ph-155181>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/22-x-24-1-1-2-mil-flat-poly-bag-ph-312239>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:23 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/16-x-11-x-8-blue-stack-hang-bins-ph-711241> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/16-x-11-x-8-blue-stack-hang-bins-ph-711241 returned 404 status code.
2025-11-01 08:22:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-3-4-x-1-3-8-fluorescent-orange-13-pt-shipping-tags-ph-423017>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-ply-315-lb-white-polypropylene-tying-twine-ph-476033>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:31 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:22:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-110-yds-clear-220-industrial-tape-ph-612063>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:34 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:22:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-60-yds-blue-11-mil-gaffers-tape-ph-693069>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:36 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 08:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-60-yds-red-10-mil-duct-tape-ph-682075>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-60-yds-white-tape-logic-masking-tape-ph-681501>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-6-open-edge-plastic-label-holders-ph-418079>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/duct-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:42 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:22:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:22:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3m-replacement-blade-for-m727-dispenser-ph-692007>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:53 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3m-1100-foam-earplugs-ph-725101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3m-1100-foam-earplugs-ph-725101 returned 404 status code.
2025-11-01 08:22:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-oz-ice-brix-cold-packs-ph-183111>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:22:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-warning-keep-this-bag-away-label-ph-413025>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-60-yds-3m-201+-masking-tape-ph-681763>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:57 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-60-black-yellow-anti-fatigue-mat-ph-737375> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-60-black-yellow-anti-fatigue-mat-ph-737375 returned 404 status code.
2025-11-01 08:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:59 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-60-charcoal-vinyl-carpet-mat-ph-737545> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-60-charcoal-vinyl-carpet-mat-ph-737545 returned 404 status code.
2025-11-01 08:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-60-yds-industrial-aluminum-foil-tape-ph-684033>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:22:59 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-60-yds-3m-301+-masking-tape-ph-681789> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-60-yds-3m-301+-masking-tape-ph-681789 returned 404 status code.
2025-11-01 08:22:59 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-60-yds-3m-401+-233+-masking-tape-ph-681791> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-60-yds-3m-401+-233+-masking-tape-ph-681791 returned 404 status code.
2025-11-01 08:23:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-ply-110-lb-jute-twine-ph-476059>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/safety-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-10-white-thermal-transfer-labels-ph-415037>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:02 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:23:02 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:04 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:23:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:05 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-10-black-yellow-anti-fatigue-mat-ph-737384> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-10-black-yellow-anti-fatigue-mat-ph-737384 returned 404 status code.
2025-11-01 08:23:05 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-10-black-premium-anti-fatigue-mat-ph-737444> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-10-black-premium-anti-fatigue-mat-ph-737444 returned 404 status code.
2025-11-01 08:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-12-black-economy-anti-fatigue-mat-ph-737386> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-12-black-economy-anti-fatigue-mat-ph-737386 returned 404 status code.
2025-11-01 08:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 7853 pages (at 368 pages/min), scraped 3311 items (at 146 items/min)
2025-11-01 08:23:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-16-black-yellow-anti-fatigue-mat-ph-737390> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-16-black-yellow-anti-fatigue-mat-ph-737390 returned 404 status code.
2025-11-01 08:23:09 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:10 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-3-4-x-2-7-8-white-13-pt-shipping-tags-ph-423557>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:14 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/safety-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-ivory-stack-hang-bin-ph-711111> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-ivory-stack-hang-bin-ph-711111 returned 404 status code.
2025-11-01 08:23:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-11-80ga-shrink-bags-ph-381113>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-15-2-mil-flat-poly-bag-ph-311504>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:19 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-12-red-black-waterhog-mat-ph-737286> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-12-red-black-waterhog-mat-ph-737286 returned 404 status code.
2025-11-01 08:23:20 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-12-brown-waterhog-mat-ph-737281> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-12-brown-waterhog-mat-ph-737281 returned 404 status code.
2025-11-01 08:23:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:21 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-16-brown-waterhog-mat-ph-737287> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-16-brown-waterhog-mat-ph-737287 returned 404 status code.
2025-11-01 08:23:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:24 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-20-charcoal-waterhog-runner-ph-737300> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-20-charcoal-waterhog-runner-ph-737300 returned 404 status code.
2025-11-01 08:23:24 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-20-brown-waterhog-runner-ph-737299> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-20-brown-waterhog-runner-ph-737299 returned 404 status code.
2025-11-01 08:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-10-2-mil-anti-static-flat-poly-bag-ph-331137>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-10-4-mil-double-track-reclosable-poly-bag-ph-315016>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/8-shelf-wire-shelving-with-yellow-bins-ph-715115> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/8-shelf-wire-shelving-with-yellow-bins-ph-715115 returned 404 status code.
2025-11-01 08:23:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-10-4-mil-reclosable-poly-bag-w-hang-hole-ph-315399>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-9-x-10-corrugated-boxes-ph-103293>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-9-x-3-white-literature-mailers-ph-212423>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:40 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/ansell-touch-n-tuff-nitrile-gloves-l-ph-891021> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/ansell-touch-n-tuff-nitrile-gloves-l-ph-891021 returned 404 status code.
2025-11-01 08:23:40 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/ansell-touch-n-tuff-nitrile-glove-xl-ph-891023> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/ansell-touch-n-tuff-nitrile-glove-xl-ph-891023 returned 404 status code.
2025-11-01 08:23:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/blue-marsh-88-valve-markers-ph-734101>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:41 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/avoid-a-fall-9-x-6-facility-sign-ph-781157> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/avoid-a-fall-9-x-6-facility-sign-ph-781157 returned 404 status code.
2025-11-01 08:23:41 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/bedford-2-ply-toilet-tissue-ph-821003> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/bedford-2-ply-toilet-tissue-ph-821003 returned 404 status code.
2025-11-01 08:23:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/box-of-rags-standard-25-lb-box-ph-827021>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/water-activated-tape-dispensers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:41 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/best-nighthawk-nitrile-gloves-xlarge-ph-891047> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/best-nighthawk-nitrile-gloves-xlarge-ph-891047 returned 404 status code.
2025-11-01 08:23:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/water-activated-tape-dispensers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/brute-domed-trash-can-lid-44-gal-gray-ph-743239>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:41 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/best-7500-nitrile-gloves-xlarge-ph-891135> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/best-7500-nitrile-gloves-xlarge-ph-891135 returned 404 status code.
2025-11-01 08:23:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/water-activated-tape-dispensers>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/water-activated-tape-dispensers>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-10-4-mil-reclosable-poly-bag-ph-315426>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:42 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/black-marsh-88-valve-markers-ph-734103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/black-marsh-88-valve-markers-ph-734103 returned 404 status code.
2025-11-01 08:23:42 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/blue-sharpie-king-size-markers-ph-734137> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/blue-sharpie-king-size-markers-ph-734137 returned 404 status code.
2025-11-01 08:23:42 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/box-of-rags-colored-t-shirt-25-lb-box-ph-827043> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/box-of-rags-colored-t-shirt-25-lb-box-ph-827043 returned 404 status code.
2025-11-01 08:23:42 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/aosafety-chemical-splash-goggles-334-ph-722103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/aosafety-chemical-splash-goggles-334-ph-722103 returned 404 status code.
2025-11-01 08:23:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/black-sharpie-magnum-markers-ph-734145> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/black-sharpie-magnum-markers-ph-734145 returned 404 status code.
2025-11-01 08:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-flat-trash-can-lid-10-gal-white-ph-743155> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-flat-trash-can-lid-10-gal-white-ph-743155 returned 404 status code.
2025-11-01 08:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/box-of-rags-premium-white-25-lb-box-ph-827027> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/box-of-rags-premium-white-25-lb-box-ph-827027 returned 404 status code.
2025-11-01 08:23:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:45 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/box-of-rags-standard-50-lb-box-ph-827023> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/box-of-rags-standard-50-lb-box-ph-827023 returned 404 status code.
2025-11-01 08:23:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-10-x-4-white-deluxe-literature-mailer-ph-212143>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-10-x-9-corrugated-boxes-ph-101047>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:49 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/box-of-huck-towels-blue-25-lb-box-ph-827047> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/box-of-huck-towels-blue-25-lb-box-ph-827047 returned 404 status code.
2025-11-01 08:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-dot-shot-high-tack-medium-profile-ph-671015>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:23:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/13-3-4-x-10-1-4-x-9-1-8-corrugated-boxes-ph-101373>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-12-x-8-double-wall-boxes-ph-115197>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-13-x-13-corrugated-boxes-ph-101699>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 8223 pages (at 370 pages/min), scraped 3474 items (at 163 items/min)
2025-11-01 08:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-16-x-16-white-corrugated-boxes-ph-111727>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-150-loop-white-3m-scotchmate-fastener-ph-674069>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-2-2-mil-flat-poly-bag-ph-311002>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-36-yds-3m-444-double-sided-film-tape-ph-653073>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-36-yds-orange-3m-764-vinyl-tape-ph-631313>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-3-4-x-1-3-8-pink-13-pt-shipping-tags-ph-423059>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/404>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/vinyl-safety-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/23-5-8-x-11-1-8-x-4-red-shelf-bins-ph-711415>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:25 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/23-5-8-x-4-1-8-x-4-blue-shelf-bins-ph-711381> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/23-5-8-x-4-1-8-x-4-blue-shelf-bins-ph-711381 returned 404 status code.
2025-11-01 08:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-120-black-uv-cable-ties-ph-443131>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:25 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/23-5-8-x-6-5-8-x-4-clear-shelf-bins-ph-711393> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/23-5-8-x-6-5-8-x-4-clear-shelf-bins-ph-711393 returned 404 status code.
2025-11-01 08:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:26 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/23-5-8-x-6-5-8-x-4-red-shelf-bins-ph-711397> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/23-5-8-x-6-5-8-x-4-red-shelf-bins-ph-711397 returned 404 status code.
2025-11-01 08:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-wardrobe-hanger-bar-ph-191155>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-110-yds-do-not-double-stack-printed-box-tape-ph-617017>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:28 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/23-x-33-black-can-liners-ph-751147> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/23-x-33-black-can-liners-ph-751147 returned 404 status code.
2025-11-01 08:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-110-yds-stop-if-seal-is-broken-tape-logic-pre-printed-carton-sealing-tape-ph-617001>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:31 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:24:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-1-1-4-white-rectangle-laser-labels-ph-414321>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-12-4-mil-reclosable-poly-bag-ph-315141>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-75-loop-black-velcro-tape-strips-ph-673163>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/carton-sealing-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:36 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:38 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-8-premium-anti-fatigue-mat-ph-737411> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-8-premium-anti-fatigue-mat-ph-737411 returned 404 status code.
2025-11-01 08:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:39 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3.14-x-1476-black-zebra-thermal-transfer-ribbons-ph-415131> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3.14-x-1476-black-zebra-thermal-transfer-ribbons-ph-415131 returned 404 status code.
2025-11-01 08:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:39 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3.15-x-984-black-zebra-thermal-transfer-ribbons-ph-415135> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3.15-x-984-black-zebra-thermal-transfer-ribbons-ph-415135 returned 404 status code.
2025-11-01 08:24:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-ply-84-lb-jute-twine-ph-476053>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-white-plastic-circle-tags-ph-427051>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-110-yds-clear-122-quiet-box-tape-ph-614111>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-10-brown-deluxe-entry-mat-ph-737454> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-10-brown-deluxe-entry-mat-ph-737454 returned 404 status code.
2025-11-01 08:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-10-red-black-waterhog-mat-ph-737208> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-10-red-black-waterhog-mat-ph-737208 returned 404 status code.
2025-11-01 08:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/special-handling-labels already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-red-hot-rush-fluorescent-red-labels-ph-411607 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-partial-fluorescent-red-labels-ph-411597 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-next-day-air-fluorescent-red-labels-ph-411577 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-saturday-delivery-fluorescent-green-labels-ph-411551 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-sample-fluorescent-red-labels-ph-411539 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-repack-fluorescent-green-labels-ph-411527 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:54 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-105-corrugated-rib-runners-ph-737577> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-105-corrugated-rib-runners-ph-737577 returned 404 status code.
2025-11-01 08:24:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-ready-to-ship-fluorescent-yellow-labels-ph-411515 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-priority-fluorescent-red-labels-ph-411503 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-partial-fluorescent-yellow-labels-ph-411491 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-caution-heavy-end-fluorescent-red-labels-ph-411485 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-partial-case-fluorescent-green-labels-ph-411479 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-cod-fluorescent-red-labels-ph-411473 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-partial-carton-fluorescent-red-labels-ph-411467 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-next-day-fluorescent-red-labels-ph-411457 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-live-animals-fluorescent-green-labels-ph-411447 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-lay-flat-fluorescent-green-labels-ph-411439 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-international-fluorescent-green-labels-ph-411429 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-export-fluorescent-yellow-labels-ph-411419 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-expedite-fluorescent-yellow-labels-ph-411409 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-customer-pick-up-fluorescent-yellow-labels-ph-411401 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-caution-sharp-objects-inside-fluor-green-labels-ph-411393 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-attention-___-fluorescent-yellow-labels-ph-411377 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-additional-parts-inside-fluorescent-red-labels-ph-411367 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-caution-heavy-fluorescent-yellow-labels-ph-411385>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-__-of-__-fluorescent-yellow-labels-ph-411357 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-skid-__-of-__-fluorescent-green-labels-ph-411347 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:24:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-5-heavy-fluorescent-yellow-labels-ph-411337 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-repack-fluorescent-green-labels-ph-411327 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:00 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-caution-heavy-fluorescent-yellow-labels-ph-411307 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-partial-case-fluorescent-green-labels-ph-411317>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-additional-parts-inside-fluorescent-red-labels-ph-411297 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-___-of-___-fluorescent-yellow-labels-ph-411287 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-6-white-warehouse-labels-magnetic-strips-ph-416201>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:04 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-6-black-yellow-anti-fatigue-mat-ph-737357> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-6-black-yellow-anti-fatigue-mat-ph-737357 returned 404 status code.
2025-11-01 08:25:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-8-1-mil-flat-poly-bag-ph-311130>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:05 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-6-gray-economy-anti-fatigue-mat-ph-737358> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-6-gray-economy-anti-fatigue-mat-ph-737358 returned 404 status code.
2025-11-01 08:25:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 8576 pages (at 353 pages/min), scraped 3628 items (at 154 items/min)
2025-11-01 08:25:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-8-black-premium-anti-fatigue-mat-ph-737428> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-8-black-premium-anti-fatigue-mat-ph-737428 returned 404 status code.
2025-11-01 08:25:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-2-1-2-white-rectangle-laser-labels-ph-414535>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-20-green-waterhog-runner-ph-737295> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-20-green-waterhog-runner-ph-737295 returned 404 status code.
2025-11-01 08:25:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-20-navy-waterhog-runner-ph-737297> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-20-navy-waterhog-runner-ph-737297 returned 404 status code.
2025-11-01 08:25:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-2-x-10-1-1-2-mil-gusseted-polypropylene-bags-ph-354173>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-8-x-023-gauge-x-2050-high-tensile-steel-strapping-ph-471083>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-3-5-8-x-11-kraft-grocery-bags-ph-925127>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-3-x-18-2-mil-gusseted-poly-bag-ph-318209>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-4-1-2-x-4-1-2-holiday-red-gift-box-ph-931135>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:26 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-shelf-wire-shelving-with-red-bins-ph-715159> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-shelf-wire-shelving-with-red-bins-ph-715159 returned 404 status code.
2025-11-01 08:25:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-5-32-green-paper-twist-ties-ph-345163>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-5-32-green-plastic-twist-ties-ph-345301>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-60-yds-3m-465-adhesive-transfer-tape-ph-651405>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:29 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:25:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-11-flush-cut-bubble-pouches-ph-532191>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-12-8-mil-reclosable-poly-bag-ph-315332>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:33 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:25:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-30-3-mil-flat-poly-bag-ph-311637>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/brute-steel-dome-lid-55-gallon-black-ph-743289>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:42 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-flat-trash-can-lid-55-gallon-blue-ph-743277> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-flat-trash-can-lid-55-gallon-blue-ph-743277 returned 404 status code.
2025-11-01 08:25:42 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-flat-trash-can-lid-55-gal-yellow-ph-743287> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-flat-trash-can-lid-55-gal-yellow-ph-743287 returned 404 status code.
2025-11-01 08:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:42 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-flat-trash-can-lid-55-gal-white-ph-743285> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-flat-trash-can-lid-55-gal-white-ph-743285 returned 404 status code.
2025-11-01 08:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-recycling-single-stream-lid-green-ph-742121> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-recycling-single-stream-lid-green-ph-742121 returned 404 status code.
2025-11-01 08:25:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-flat-trash-can-lid-55-gal-black-ph-743275> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-flat-trash-can-lid-55-gal-black-ph-743275 returned 404 status code.
2025-11-01 08:25:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-square-can-flat-lid-28-gal-white-ph-743111> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-square-can-flat-lid-28-gal-white-ph-743111 returned 404 status code.
2025-11-01 08:25:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-square-trash-can-40-gallon-gray-ph-743113> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-square-trash-can-40-gallon-gray-ph-743113 returned 404 status code.
2025-11-01 08:25:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-recycling-container-32-gal-blue-ph-742123> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-recycling-container-32-gal-blue-ph-742123 returned 404 status code.
2025-11-01 08:25:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-trash-can-10-gallon-blue-ph-743133> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-trash-can-10-gallon-blue-ph-743133 returned 404 status code.
2025-11-01 08:25:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-square-can-flat-lid-40-gal-white-ph-743119> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-square-can-flat-lid-40-gal-white-ph-743119 returned 404 status code.
2025-11-01 08:25:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-trash-can-20-gallon-green-ph-743163> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-trash-can-20-gallon-green-ph-743163 returned 404 status code.
2025-11-01 08:25:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-trash-can-20-gallon-gray-ph-743165> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-trash-can-20-gallon-gray-ph-743165 returned 404 status code.
2025-11-01 08:25:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-trash-can-44-gallon-gray-ph-743229> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-trash-can-44-gallon-gray-ph-743229 returned 404 status code.
2025-11-01 08:25:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-trash-can-55-gallon-green-ph-743261> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-trash-can-55-gallon-green-ph-743261 returned 404 status code.
2025-11-01 08:25:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-trash-can-55-gallon-white-ph-743267> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-trash-can-55-gallon-white-ph-743267 returned 404 status code.
2025-11-01 08:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/contractors-bag-black-40-45-gal-3-mil-ph-756107> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/contractors-bag-black-40-45-gal-3-mil-ph-756107 returned 404 status code.
2025-11-01 08:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:45 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/cotton-inspection-gloves-35-oz-small-ph-891233> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/cotton-inspection-gloves-35-oz-small-ph-891233 returned 404 status code.
2025-11-01 08:25:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/deluxe-cowhide-leather-driver-glove-l-ph-891273> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/deluxe-cowhide-leather-driver-glove-l-ph-891273 returned 404 status code.
2025-11-01 08:25:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/door-sign-manager-ph-781175> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/door-sign-manager-ph-781175 returned 404 status code.
2025-11-01 08:25:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/deluxe-urinal-screen-spiced-apple-ph-826011> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/deluxe-urinal-screen-spiced-apple-ph-826011 returned 404 status code.
2025-11-01 08:25:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/door-sign-no-admittance-ph-781189> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/door-sign-no-admittance-ph-781189 returned 404 status code.
2025-11-01 08:25:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/door-sign-storage-ph-781179> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/door-sign-storage-ph-781179 returned 404 status code.
2025-11-01 08:25:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/cowhide-leather-driver-glove-lined-xl-ph-891269> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/cowhide-leather-driver-glove-lined-xl-ph-891269 returned 404 status code.
2025-11-01 08:25:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/e-a-rsoft-yellow-neons-corded-earplugs-ph-725107> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/e-a-rsoft-yellow-neons-corded-earplugs-ph-725107 returned 404 status code.
2025-11-01 08:25:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/e-a-r-one-touch-pro-earplug-dispenser-ph-725117> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/e-a-r-one-touch-pro-earplug-dispenser-ph-725117 returned 404 status code.
2025-11-01 08:25:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/cotton-inspection-gloves-25-oz-small-ph-891227> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/cotton-inspection-gloves-25-oz-small-ph-891227 returned 404 status code.
2025-11-01 08:25:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/continuous-air-freshener-refill-blue-splash-ph-827011> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/continuous-air-freshener-refill-blue-splash-ph-827011 returned 404 status code.
2025-11-01 08:25:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-12-medium-gray-waterhog-mat-ph-737212> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-12-medium-gray-waterhog-mat-ph-737212 returned 404 status code.
2025-11-01 08:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-1-fluorescent-pastel-blue-rectangle-laser-labels-ph-414395>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-15-gray-economy-anti-fatigue-mat-ph-737373> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-15-gray-economy-anti-fatigue-mat-ph-737373 returned 404 status code.
2025-11-01 08:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-16-red-black-waterhog-mat-ph-737220> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-16-red-black-waterhog-mat-ph-737220 returned 404 status code.
2025-11-01 08:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/402-x-1181-black-datamax-thermal-transfer-ribbons-ph-415151>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:25:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/40-x-8-x-8-long-corrugated-boxes-ph-102933>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-3-x-3-kraft-corrugated-mailers-ph-211123>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:02 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/40-x-46-black-can-liners-ph-751169> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/40-x-46-black-can-liners-ph-751169 returned 404 status code.
2025-11-01 08:26:02 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/40-x-46-clear-can-liners-ph-751121> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/40-x-46-clear-can-liners-ph-751121 returned 404 status code.
2025-11-01 08:26:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-1-mil-flat-poly-bag-ph-311234>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-3-mil-flat-poly-bag-ph-311257>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-dangerous-when-wet-4-labels-ph-413049>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-dark-blue-inventory-rectangle-labels-ph-412707>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 8947 pages (at 371 pages/min), scraped 3787 items (at 159 items/min)
2025-11-01 08:26:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-x-20-4-mil-reclosable-poly-bag-ph-315361> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-x-20-4-mil-reclosable-poly-bag-ph-315361 returned 404 status code.
2025-11-01 08:26:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-3-x-3-kraft-corrugated-mailers-ph-211159>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:16 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-x-36-2-mil-flat-poly-bag-ph-311428> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-x-36-2-mil-flat-poly-bag-ph-311428 returned 404 status code.
2025-11-01 08:26:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-5-2-mil-flat-poly-bag-ph-311354>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-5-x-12-white-square-mailing-tubes-ph-213651>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-6-4-mil-reclosable-poly-bag-ph-315160>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-6-8-mil-reclosable-poly-bag-ph-315188>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:26 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-6-green-waterhog-mat-ph-737265> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-6-green-waterhog-mat-ph-737265 returned 404 status code.
2025-11-01 08:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:27 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-6-brown-waterhog-mat-ph-737263> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-6-brown-waterhog-mat-ph-737263 returned 404 status code.
2025-11-01 08:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/esd-palm-coated-nylon-gloves-large-ph-891083>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/exam-grade-latex-gloves-powder-free-s-ph-891139>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:39 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/safety-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:26:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:41 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 08:26:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/fire-hose-9-x-6-facility-sign-ph-781153> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/fire-hose-9-x-6-facility-sign-ph-781153 returned 404 status code.
2025-11-01 08:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/fluorescent-green-sharpie-highlighters-ph-734165> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/fluorescent-green-sharpie-highlighters-ph-734165 returned 404 status code.
2025-11-01 08:26:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/gojo-cherry-gel-pumice-hand-cleaner-ph-822037> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/gojo-cherry-gel-pumice-hand-cleaner-ph-822037 returned 404 status code.
2025-11-01 08:26:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/goatskin-leather-drivers-gloves-medium-ph-891277> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/goatskin-leather-drivers-gloves-medium-ph-891277 returned 404 status code.
2025-11-01 08:26:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:45 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/gojo-fast-wipes-ph-846001> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/gojo-fast-wipes-ph-846001 returned 404 status code.
2025-11-01 08:26:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/gritless-sweeping-compound-50-lb-bag-ph-842003> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/gritless-sweeping-compound-50-lb-bag-ph-842003 returned 404 status code.
2025-11-01 08:26:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/green-sharpie-fine-point-markers-ph-734123> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/green-sharpie-fine-point-markers-ph-734123 returned 404 status code.
2025-11-01 08:26:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hands-free-trash-can-lid-35-gallon-beige-ph-746105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hands-free-trash-can-lid-35-gallon-beige-ph-746105 returned 404 status code.
2025-11-01 08:26:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/guarded-auto-retracting-safety-cutter-ph-732115> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/guarded-auto-retracting-safety-cutter-ph-732115 returned 404 status code.
2025-11-01 08:26:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/gojo-wall-mount-dispenser-white-ph-822041> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/gojo-wall-mount-dispenser-white-ph-822041 returned 404 status code.
2025-11-01 08:26:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-natural-33-gallon-47-mil-ph-754115> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-natural-33-gallon-47-mil-ph-754115 returned 404 status code.
2025-11-01 08:26:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-natural-56-gallon-67-mil-ph-754123> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-natural-56-gallon-67-mil-ph-754123 returned 404 status code.
2025-11-01 08:26:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-12-x-8-jumbo-bin-boxes-ph-171149>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-natural-7-10-gallon-31-mil-ph-754103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-natural-7-10-gallon-31-mil-ph-754103 returned 404 status code.
2025-11-01 08:26:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/kimtech-1-ply-147-x-166-precision-low-lint-wipers-ph-844027> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/kimtech-1-ply-147-x-166-precision-low-lint-wipers-ph-844027 returned 404 status code.
2025-11-01 08:26:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-natural-20-30-gal-63-mil-ph-754113> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-natural-20-30-gal-63-mil-ph-754113 returned 404 status code.
2025-11-01 08:26:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10x13-red-poly-mailers-ph-221164>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-13-red-tyvek-envelopes-ph-261141>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-13-silver-tyvek-envelopes-ph-261143>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-natural-60-gallon-67-mil-ph-754131> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-natural-60-gallon-67-mil-ph-754131 returned 404 status code.
2025-11-01 08:26:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/kimtech-98-x-134-prep-jumbo-roll-wipers-ph-844033> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/kimtech-98-x-134-prep-jumbo-roll-wipers-ph-844033 returned 404 status code.
2025-11-01 08:26:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/kleenex-boutique-facial-tissue-ph-881000> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/kleenex-boutique-facial-tissue-ph-881000 returned 404 status code.
2025-11-01 08:26:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/kimwipes-1-ply-44-x-84-low-lint-wipers-ph-844013> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/kimwipes-1-ply-44-x-84-low-lint-wipers-ph-844013 returned 404 status code.
2025-11-01 08:26:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/knifehandler-gloves-extra-large-ph-891067> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/knifehandler-gloves-extra-large-ph-891067 returned 404 status code.
2025-11-01 08:26:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/kimtech-1-ply-44-x-84-precision-low-lint-wipers-ph-844025> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/kimtech-1-ply-44-x-84-precision-low-lint-wipers-ph-844025 returned 404 status code.
2025-11-01 08:26:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-natural-60-gallon-55-mil-ph-754129> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-natural-60-gallon-55-mil-ph-754129 returned 404 status code.
2025-11-01 08:26:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/gojo-natural-orange-smooth-hand-cleaner-refill-ph-822023> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/gojo-natural-orange-smooth-hand-cleaner-refill-ph-822023 returned 404 status code.
2025-11-01 08:26:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-023-gauge-x-2560-high-tensile-steel-strapping-ph-471021>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-10-x-24-2-mil-gusseted-poly-bag-ph-318457>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-3-8-hook-white-velcro-tape-dots-ph-673129>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:05 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/13-pt-steel-track-utility-knife-w-grip-ph-732127> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/13-pt-steel-track-utility-knife-w-grip-ph-732127 returned 404 status code.
2025-11-01 08:27:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/13-x-14-2-mil-flat-poly-bag-ph-312019>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 9329 pages (at 382 pages/min), scraped 3952 items (at 165 items/min)
2025-11-01 08:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-36-1-1-2-mil-flat-poly-bag-ph-311939>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:12 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-4-white-warehouse-labels-magnetic-strips-ph-416153>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-50-red-warehouse-labels-magnetic-rolls-ph-416049>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-5-yds-dark-gray-3m-5925-vhb-tape-ph-696135>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:24 [py.warnings] (PID: 95) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2025-11-01 08:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-60-yds-3m-2526-flatback-tape-ph-624049>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-12-x-12-double-wall-box--hand-holes-ph-115353>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:24 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-x-60-yds-13m-101+-masking-tape-ph-681471> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-x-60-yds-13m-101+-masking-tape-ph-681471 returned 404 status code.
2025-11-01 08:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:24 [scrapy.extensions.feedexport] (PID: 95) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:4
2025-11-01 08:27:24 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-x-60-yds-13m-201+-masking-tape-ph-681475> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-x-60-yds-13m-201+-masking-tape-ph-681475 returned 404 status code.
2025-11-01 08:27:25 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-x-60-yds-13m-301+-masking-tape-ph-681541> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-x-60-yds-13m-301+-masking-tape-ph-681541 returned 404 status code.
2025-11-01 08:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-16-x-24-2-mil-gusseted-poly-bag-ph-318619>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:29 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:27:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-18-corrugated-sheets-ph-112195>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:30 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:31 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:32 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:27:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-200-carpet-protection-tape-ph-637007>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:33 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:33 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:35 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:27:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:38 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:27:38 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:39 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/30-x-30-4-mil-reclosable-poly-bag-ph-315599>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/30-x-3-1-2-x-40-1-piece-of-4-piece-mirror-box-ph-191145>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/30-x-60-corrugated-sheets-ph-112237>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/30-x-6-x-6-long-corrugated-boxes-ph-102777>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/30-x-36-clear-can-liners-ph-751111> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/30-x-36-clear-can-liners-ph-751111 returned 404 status code.
2025-11-01 08:27:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:27:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:27:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:27:59 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-x-30-4-mil-reclosable-poly-bag-ph-315447> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-x-30-4-mil-reclosable-poly-bag-ph-315447 returned 404 status code.
2025-11-01 08:28:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-12-x-12-heavy-duty-boxes-ph-115099>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-12-x-30-3-mil-gusseted-poly-bag-ph-318477>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 9716 pages (at 387 pages/min), scraped 4120 items (at 168 items/min)
2025-11-01 08:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/13-x-7-x-7-long-corrugated-boxes-ph-101425>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-red-stack-hang-bin-ph-711207>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:20 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-clear-stack-hang-bin-ph-711229> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-clear-stack-hang-bin-ph-711229 returned 404 status code.
2025-11-01 08:28:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:20 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-ivory-stack-hang-bin-ph-711237> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-ivory-stack-hang-bin-ph-711237 returned 404 status code.
2025-11-01 08:28:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/17-1-4-x-11-1-4-x-2-white-easy-fold-mailer-ph-211809>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:21 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-blue-stack-hang-bin-ph-711199> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-blue-stack-hang-bin-ph-711199 returned 404 status code.
2025-11-01 08:28:21 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-black-conductive-bin-ph-711423> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-black-conductive-bin-ph-711423 returned 404 status code.
2025-11-01 08:28:21 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-ivory-stack-hang-bin-ph-711209> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-ivory-stack-hang-bin-ph-711209 returned 404 status code.
2025-11-01 08:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:23 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-black-stack-hang-bin-ph-711205> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-black-stack-hang-bin-ph-711205 returned 404 status code.
2025-11-01 08:28:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:23 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-ivory-stack-hang-bin-ph-711223> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-ivory-stack-hang-bin-ph-711223 returned 404 status code.
2025-11-01 08:28:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:25 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-black-stack-hang-bin-ph-711219> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-black-stack-hang-bin-ph-711219 returned 404 status code.
2025-11-01 08:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:26 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-7-8-x-6-5-8-x-4-red-shelf-bins-ph-711359> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-7-8-x-6-5-8-x-4-red-shelf-bins-ph-711359 returned 404 status code.
2025-11-01 08:28:26 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-7-8-x-8-3-8-x-4-clear-shelf-bins-ph-711365> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-7-8-x-8-3-8-x-4-clear-shelf-bins-ph-711365 returned 404 status code.
2025-11-01 08:28:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/17-x-17-x-9-corrugated-boxes-ph-101853>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-60-yds-3m-8981-strapping-tape-ph-642211>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:27 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-7-8-x-6-5-8-x-4-clear-shelf-bins-ph-711355> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-7-8-x-6-5-8-x-4-clear-shelf-bins-ph-711355 returned 404 status code.
2025-11-01 08:28:27 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-7-8-x-8-3-8-x-4-yellow-shelf-bins-ph-711371> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-7-8-x-8-3-8-x-4-yellow-shelf-bins-ph-711371 returned 404 status code.
2025-11-01 08:28:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:28 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-x-14-1-2-x-12-7-8-red-stack-nest-bin-ph-717123> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-x-14-1-2-x-12-7-8-red-stack-nest-bin-ph-717123 returned 404 status code.
2025-11-01 08:28:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-60-yds-red-11-mil-gaffers-tape-ph-693015>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-adhesive-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:29 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-x-60-yds-3m-9485.c-adhesive-transfer-tape-ph-651035> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-x-60-yds-3m-9485.c-adhesive-transfer-tape-ph-651035 returned 404 status code.
2025-11-01 08:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:32 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-7-8-x-4-1-8-x-4-green-shelf-bins-ph-711347> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-7-8-x-4-1-8-x-4-green-shelf-bins-ph-711347 returned 404 status code.
2025-11-01 08:28:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2.36-x-1181-black-datamax-thermal-transfer-ribbons-wax-ph-415113>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-20-x-20-corrugated-boxes-ph-102415>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:34 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/20-1-4-x-14-1-4-x-12-3-4-round-trip-tote-ph-717103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/20-1-4-x-14-1-4-x-12-3-4-round-trip-tote-ph-717103 returned 404 status code.
2025-11-01 08:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/hook-and-loop-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-24-flush-cut-bubble-pouches-ph-532269>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:37 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:38 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/24-x-23-clear-can-liners-ph-751103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/24-x-23-clear-can-liners-ph-751103 returned 404 status code.
2025-11-01 08:28:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:40 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-24-x-2-anti-static-pick-pack-foam-ph-547125>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:42 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:28:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:43 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-green-tubes-with-caps-ph-213281>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-yds-3-pack-yellow-3m-471-vinyl-tape-ph-631393>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-1-4-x-1-5-8-green-13-pt-shipping-tags-ph-423119>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-28-2-mil-flat-poly-bag-ph-311190>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-30-red-premium-telescoping-tubes-ph-213713>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-36-kraft-heavy-duty-tubes-with-caps-ph-213527>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-36-yds-black-yellow-3m-766-striped-vinyl-tape-ph-631511>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 10092 pages (at 376 pages/min), scraped 4274 items (at 154 items/min)
2025-11-01 08:29:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-1-2-x-5-1-2-orange-invoice-enclosed-envelopes-ph-453039>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-1-4-x-2-1-8-dark-blue-13-pt-shipping-tags-pre-strung-ph-423235>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-1-4-x-2-1-8-fluor-pink-13-pt-shipping-tag-pre-strung-ph-423253>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-health-hazard-fire-hazard-reactivity-label-ph-413209>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-radioactive-i-labels-ph-413173>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-white-thermal-transfer-labels-ph-415053>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-x-3-kraft-corrugated-mailers-ph-211135>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-x-8-tall-corrugated-boxes-ph-102985>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-6-self-seal-bubble-pouches-ph-532147>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/wholesale-label-protection-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-8-reclosable-static-shielding-bags-ph-334189>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:40 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-8-charcoal-waterhog-mat-ph-737270> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-8-charcoal-waterhog-mat-ph-737270 returned 404 status code.
2025-11-01 08:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:42 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-8-medium-gray-waterhog-mat-ph-737272> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-8-medium-gray-waterhog-mat-ph-737272 returned 404 status code.
2025-11-01 08:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-9-4-mil-white-block-reclosable-poly-bag-ph-317159>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-9-8-mil-reclosable-poly-bag-ph-315190>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:45 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-8-green-waterhog-mat-ph-737271> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-8-green-waterhog-mat-ph-737271 returned 404 status code.
2025-11-01 08:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-8-1-1-2-mil-resealable-polypropylene-bags-ph-354295>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/kraft-25-pk-4-heat-seal-bubble-mailer-ph-241219>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/kraft-3-self-seal-bubble-mailer-w-tear-strip-ph-241197>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/kraft-6-self-seal-padded-mailer-ph-251167>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/legal-interlocking-flap-file-storage-box-ph-718109>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/legal-stor-drawer-file-storage-drawers-ph-718141>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:29:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:29:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-5-32-orange-paper-twist-ties-ph-345107>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:01 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/latex-industrial-gloves-medium-ph-891149> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/latex-industrial-gloves-medium-ph-891149 returned 404 status code.
2025-11-01 08:30:02 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/latex-industrial-gloves-powder-free-xl-ph-891163> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/latex-industrial-gloves-powder-free-xl-ph-891163 returned 404 status code.
2025-11-01 08:30:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-8-x-10-corrugated-boxes-ph-101075>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/water-activated-tape-dispensers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:03 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/magic-soft-facial-tissue-ph-881001> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/magic-soft-facial-tissue-ph-881001 returned 404 status code.
2025-11-01 08:30:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:04 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/latex-glove-powder-free-w-extended-cuff-m-ph-891167> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/latex-glove-powder-free-w-extended-cuff-m-ph-891167 returned 404 status code.
2025-11-01 08:30:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-15-1-2-flat-ship-lite-envelopes-ph-262111>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-15-1-2-returnable-poly-mailer-ph-221175>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 10449 pages (at 357 pages/min), scraped 4444 items (at 170 items/min)
2025-11-01 08:30:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-15-2-mil-blue-flat-poly-bag-ph-312012>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-10-x-10-heavy-duty-boxes-ph-115139>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-14-x-10-corrugated-boxes-ph-101495>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/17-x-6-x-29-1-2-kraft-grocery-bags-ph-925155>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-50-fluorescent-pink-cable-ties-ph-441213>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:26 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-x-9-3-4-stack-hang-bin-dividers-ph-712121> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-x-9-3-4-stack-hang-bin-dividers-ph-712121 returned 404 status code.
2025-11-01 08:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18--butcher-paper-rolls-ph-512193>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:31 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-wide-seal-foot-operated-impulse-sealer-ph-344147> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-wide-seal-foot-operated-impulse-sealer-ph-344147 returned 404 status code.
2025-11-01 08:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:33 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-11-x-10-yellow-stack-hang-bins-ph-711281> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-11-x-10-yellow-stack-hang-bins-ph-711281 returned 404 status code.
2025-11-01 08:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-7-8-x-18-1-4-blue-stack-nest-lids-ph-717151>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-100ga-reynolon-5044-pvc-shrink-film-ph-383155>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-18-x-30-1-1-2-mil-gusseted-poly-bag-ph-318579>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-36-2-mil-reclosable-poly-bag-ph-315588>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-300-parcel-ready-perfed-bubble-rolls-ph-531145 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-30-reclosable-static-shielding-bags-ph-334405 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-30-4-mil-flat-poly-bag-ph-312205 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-32-2-mil-flat-poly-bag-ph-312178 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-36-100-pack-poly-mailer-ph-221143 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-36--50-lb-kraft-paper-sheets-ph-511241 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-300-parcel-ready-perfed-bubble-rolls-ph-531145 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-30-reclosable-static-shielding-bags-ph-334405 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-36-6-mil-anti-static-flat-poly-bag-ph-331365 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-30-4-mil-flat-poly-bag-ph-312205 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-32-2-mil-flat-poly-bag-ph-312178 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-36-100-pack-poly-mailer-ph-221143 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-36--50-lb-kraft-paper-sheets-ph-511241 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-300-parcel-ready-perfed-bubble-rolls-ph-531145 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <POST https://www.packaginghero.com/Product/GetPriceWithInventory> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <POST https://www.packaginghero.com/Product/GetPriceWithInventory> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <POST https://www.packaginghero.com/Product/GetPriceWithInventory> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <POST https://www.packaginghero.com/Product/GetPriceWithInventory> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <POST https://www.packaginghero.com/Product/GetPriceWithInventory> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/24-x-30-reclosable-static-shielding-bags-ph-334405> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-36-6-mil-anti-static-flat-poly-bag-ph-331365 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <POST https://www.packaginghero.com/Product/GetPriceWithInventory> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/24-x-30-4-mil-flat-poly-bag-ph-312205> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/24-x-32-2-mil-flat-poly-bag-ph-312178> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/24-x-36-100-pack-poly-mailer-ph-221143> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <POST https://www.packaginghero.com/Product/GetPriceWithInventory> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <POST https://www.packaginghero.com/Product/GetPriceWithInventory> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/24-x-36--50-lb-kraft-paper-sheets-ph-511241> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <POST https://www.packaginghero.com/Product/GetPriceWithInventory> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <POST https://www.packaginghero.com/Product/GetPriceWithInventory> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-30-reclosable-static-shielding-bags-ph-334405>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <POST https://www.packaginghero.com/Product/GetPriceWithInventory> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/24-x-300-parcel-ready-perfed-bubble-rolls-ph-531145> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-30-4-mil-flat-poly-bag-ph-312205>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <POST https://www.packaginghero.com/Product/GetPriceWithInventory> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <POST https://www.packaginghero.com/Product/GetPriceWithInventory> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-32-2-mil-flat-poly-bag-ph-312178>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-36-8-mil-flat-poly-bag-ph-312320 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-36-100-pack-poly-mailer-ph-221143>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-54-4-mil-flat-poly-bag-ph-312186>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-36-blue-plastic-corrugated-sheets-ph-112109 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-36-chipboard-pads-ph-481053 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-36-open-end-static-shielding-bags-ph-334407 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-36--50-lb-kraft-paper-sheets-ph-511241>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24x36-poly-mailers-with-tear-strip-ph-221140 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-36--waxed-paper-sheets-ph-512191 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/24-x-36-6-mil-anti-static-flat-poly-bag-ph-331365> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-38-1-1-2-mil-flat-poly-bag-ph-312250 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-300-parcel-ready-perfed-bubble-rolls-ph-531145>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-yds-green-3m-764-vinyl-tape-ph-631461>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-42-4-mil-flat-poly-bag-ph-312210 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-48-corrugated-sheets-ph-112211 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-4-x-4-kraft-corrugated-mailers-ph-211667 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-5-x-24-side-loading-boxes-ph-114509 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-60-4-mil-flat-poly-bag-ph-312212 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-black-white-striped-vinyl-safety-tape-ph-631175 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-blue-3m-764-vinyl-tape-ph-631437 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-blue-solid-vinyl-safety-tape-ph-631195 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-clear-3m-764-vinyl-tape-ph-631445 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-36-6-mil-anti-static-flat-poly-bag-ph-331365>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-green-solid-vinyl-safety-tape-ph-631203 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-orange-3m-764-vinyl-tape-ph-631479 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-36-8-mil-flat-poly-bag-ph-312320 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-36-blue-plastic-corrugated-sheets-ph-112109 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-36-chipboard-pads-ph-481053 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-36-open-end-static-shielding-bags-ph-334407 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24x36-poly-mailers-with-tear-strip-ph-221140 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-38-1-1-2-mil-flat-poly-bag-ph-312250 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-42-4-mil-flat-poly-bag-ph-312210 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-yds-orange-3m-764-vinyl-tape-ph-631475>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-48-corrugated-sheets-ph-112211 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-4-x-4-kraft-corrugated-mailers-ph-211667 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-5-x-24-side-loading-boxes-ph-114509 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-60-4-mil-flat-poly-bag-ph-312212 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-black-white-striped-vinyl-safety-tape-ph-631175 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-blue-3m-764-vinyl-tape-ph-631437 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-blue-solid-vinyl-safety-tape-ph-631195 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-36--waxed-paper-sheets-ph-512191>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-clear-3m-764-vinyl-tape-ph-631445 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-yds-red-3m-764-vinyl-tape-ph-631485>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-white-3m-471-vinyl-tape-ph-631493 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-orange-3m-764-vinyl-tape-ph-631479 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/24-x-36-8-mil-flat-poly-bag-ph-312320> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/24-x-36-blue-plastic-corrugated-sheets-ph-112109> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/24-x-36-chipboard-pads-ph-481053> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/24-x-36-open-end-static-shielding-bags-ph-334407> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/24x36-poly-mailers-with-tear-strip-ph-221140> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-white-3m-764-vinyl-tape-ph-631491 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-white-3-pack-solid-vinyl-safety-tape-ph-631247 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/24-x-38-1-1-2-mil-flat-poly-bag-ph-312250> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-yds-green-solid-vinyl-safety-tape-ph-631203>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/24-x-42-4-mil-flat-poly-bag-ph-312210> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-yds-yellow-3m-764-vinyl-tape-ph-631501>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-36-8-mil-flat-poly-bag-ph-312320>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/24-x-48-corrugated-sheets-ph-112211> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/24-x-4-x-4-kraft-corrugated-mailers-ph-211667> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/24-x-5-x-24-side-loading-boxes-ph-114509> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-36-blue-plastic-corrugated-sheets-ph-112109>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/24-x-60-4-mil-flat-poly-bag-ph-312212> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-36-chipboard-pads-ph-481053>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-36-open-end-static-shielding-bags-ph-334407>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24x36-poly-mailers-with-tear-strip-ph-221140>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-do-not-double-stack-fluorescent-red-labels-ph-411105>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-do-not-drop-labels-ph-411185>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-36-yds-black-white-striped-vinyl-safety-tape-ph-631175> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-36-yds-blue-3m-764-vinyl-tape-ph-631437> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-36-yds-blue-solid-vinyl-safety-tape-ph-631195> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-36-yds-clear-3m-764-vinyl-tape-ph-631445> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-38-1-1-2-mil-flat-poly-bag-ph-312250>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-42-4-mil-flat-poly-bag-ph-312210>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-yellow-3-pack-solid-vinyl-safety-tape-ph-631255 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-white-3m-471-vinyl-tape-ph-631493 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-36-yds-orange-3m-764-vinyl-tape-ph-631479> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-48-corrugated-sheets-ph-112211>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-8-mil-reclosable-poly-bag-ph-315040 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-4-x-4-kraft-corrugated-mailers-ph-211667>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-5-x-24-side-loading-boxes-ph-114509>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-60-4-mil-flat-poly-bag-ph-312212>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-dark-blue-inventory-rectangle-labels-ph-412275 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-do-not-break-stretch-wrap-fluor-green-labels-ph-411041 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-do-not-crush-fluorescent-yellow-labels-ph-411063 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-yds-black-white-striped-vinyl-safety-tape-ph-631175>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-do-not-stack-labels-ph-411247 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-yds-blue-3m-764-vinyl-tape-ph-631437>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-yds-blue-solid-vinyl-safety-tape-ph-631195>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-yds-clear-3m-764-vinyl-tape-ph-631445>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-white-3m-764-vinyl-tape-ph-631491 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-36-yds-white-3-pack-solid-vinyl-safety-tape-ph-631247 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-fluorescent-packs-inventory-rectangle-labels-ph-412193 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-fluorescent-pink-inventory-rectangle-labels-ph-412287 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-yds-orange-3m-764-vinyl-tape-ph-631479>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-fluorescent-yellow-inventory-rectangle-labels-ph-412295 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-fragile-fluorescent-green-labels-ph-411757 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-fragile-glass-handle-with-care-labels-ph-411815 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-fragile-handle-with-care-fluorescent-red-labels-ph-411521 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-fragile-liquid-in-glass-handle-with-care-labels-ph-411819 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-fragile-liquid-handle-with-care-labels-ph-411817 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-fragile-this-side-up-hwc-labels-ph-411751 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-36-yds-white-3m-471-vinyl-tape-ph-631493> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-glass-handle-with-care-thank-you-labels-ph-411821 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-8-mil-reclosable-poly-bag-ph-315040 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-fragile-glass-handle-with-care-labels-ph-411813>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-dark-blue-inventory-rectangle-labels-ph-412275 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-do-not-break-stretch-wrap-fluor-green-labels-ph-411041 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-do-not-crush-fluorescent-yellow-labels-ph-411063 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-do-not-stack-labels-ph-411247 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-36-yds-white-3m-764-vinyl-tape-ph-631491> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-36-yds-white-3-pack-solid-vinyl-safety-tape-ph-631247> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-fluorescent-packs-inventory-rectangle-labels-ph-412193 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-yds-yellow-3-pack-solid-vinyl-safety-tape-ph-631255>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-fluorescent-pink-inventory-rectangle-labels-ph-412287 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-yds-white-3m-471-vinyl-tape-ph-631493>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-16-x-24-x-300-cohesive-bubble-rolls-ph-531141>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-fluorescent-yellow-inventory-rectangle-labels-ph-412295 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-fragile-fluorescent-green-labels-ph-411757 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-fragile-glass-handle-with-care-labels-ph-411815 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-fragile-handle-with-care-fluorescent-red-labels-ph-411521 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-fragile-liquid-in-glass-handle-with-care-labels-ph-411819 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-fragile-liquid-handle-with-care-labels-ph-411817 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-yds-white-3m-764-vinyl-tape-ph-631491>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-fragile-this-side-up-hwc-labels-ph-411751 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-yds-white-3-pack-solid-vinyl-safety-tape-ph-631247>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-16-x-16-x-750-air-bubble-rolls-ph-531131 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-16-x-48-x-750-perfed-bubble-roll-ph-531163 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-3-glass-handle-with-care-thank-you-labels-ph-411821 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-3-8-mil-reclosable-poly-bag-ph-315040> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-16-x-12-x-300-cohesive-bubble-rolls-ph-531117>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-3-dark-blue-inventory-rectangle-labels-ph-412275> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-3-do-not-break-stretch-wrap-fluor-green-labels-ph-411041> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-3-do-not-crush-fluorescent-yellow-labels-ph-411063> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-3-do-not-stack-labels-ph-411247> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/32-175-jumbo-cable-ties-natural-ph-442025 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-3-fluorescent-packs-inventory-rectangle-labels-ph-412193> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-3-fluorescent-pink-inventory-rectangle-labels-ph-412287> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-8-mil-reclosable-poly-bag-ph-315040>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-3-fluorescent-yellow-inventory-rectangle-labels-ph-412295> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-3-fragile-fluorescent-green-labels-ph-411757> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/32-x-12-x-10-long-corrugated-boxes-ph-102787 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-dark-blue-inventory-rectangle-labels-ph-412275>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/32-x-28-x-72-2-mil-clear-pallet-covers-ph-351105>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/32-x-32-x-12-corrugated-boxes-ph-102801>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-3-fragile-glass-handle-with-care-labels-ph-411815> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-do-not-break-stretch-wrap-fluor-green-labels-ph-411041>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-do-not-crush-fluorescent-yellow-labels-ph-411063>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-do-not-stack-labels-ph-411247>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-3-fragile-handle-with-care-fluorescent-red-labels-ph-411521> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-3-fragile-liquid-in-glass-handle-with-care-labels-ph-411819> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-3-fragile-liquid-handle-with-care-labels-ph-411817> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-3-fragile-this-side-up-hwc-labels-ph-411751> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-fluorescent-packs-inventory-rectangle-labels-ph-412193>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/32-oz-ice-brix-cold-packs-ph-183109>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-fluorescent-pink-inventory-rectangle-labels-ph-412287>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/2-x-3-glass-handle-with-care-thank-you-labels-ph-411821> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-fluorescent-yellow-inventory-rectangle-labels-ph-412295>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/32-x-1450-3-mil-poly-tubing-ph-353399 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-fragile-fluorescent-green-labels-ph-411757>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/32-x-32-x-32-double-wall-boxes-ph-115469 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-fragile-glass-handle-with-care-labels-ph-411815>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/32-x-32-x-8-flat-corrugated-boxes-ph-102805 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-fragile-handle-with-care-fluorescent-red-labels-ph-411521>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/32-x-48-2-mil-flat-poly-bag-ph-312408 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/32-x-50-1-1-2-mil-flat-poly-bag-ph-312387 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-fragile-liquid-in-glass-handle-with-care-labels-ph-411819>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-fragile-liquid-handle-with-care-labels-ph-411817>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/32-175-jumbo-cable-ties-natural-ph-442025 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-fragile-this-side-up-hwc-labels-ph-411751>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-32-x-12-x-750-perforated-foam-rolls-ph-541177 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-16-x-16-x-750-air-bubble-rolls-ph-531131>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-3-4-x-1-7-8-fluor-yellow-13-pt-shipping-tag-wired-ph-423191>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-32-x-18-x-750-perforated-foam-rolls-ph-541181 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-32-x-48-x-750-perforated-foam-roll-ph-541193 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-glass-handle-with-care-thank-you-labels-ph-411821>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-16-x-48-x-750-perfed-bubble-roll-ph-531163>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-32-x-6-x-750-air-foam-rolls-ph-541195 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/32-x-12-x-10-long-corrugated-boxes-ph-102787 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-32-x-72-x-750-air-foam-roll-ph-541199 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-32-x-72-x-750-perforated-foam-roll-ph-541201 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/333-white-circle-laser-labels-ph-414449 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-3-4-x-1-7-8-10-pt-manila-shipping-tags-pre-strung-ph-422025 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-3-4-x-1-7-8-13-pt-manila-shipping-tags-ph-422035 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-3-4-x-1-7-8-fluorescent-red-13-pt-shipping-tags-ph-423185 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-3-4-x-1-7-8-green-13-pt-shipping-tags-pre-wired-ph-423195 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-3-4-x-1-7-8-green-tyvek-shipping-tag-ph-424057 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-3-4-x-1-7-8-light-blue-13-pt-shipping-tags-ph-423203 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/32-x-1450-3-mil-poly-tubing-ph-353399 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/32-x-32-x-32-double-wall-boxes-ph-115469 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/32-x-32-x-8-flat-corrugated-boxes-ph-102805 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/32-x-48-2-mil-flat-poly-bag-ph-312408 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/32-x-50-1-1-2-mil-flat-poly-bag-ph-312387 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/32-175-jumbo-cable-ties-natural-ph-442025> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-32-x-12-x-750-perforated-foam-rolls-ph-541177 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/32-x-12-x-10-long-corrugated-boxes-ph-102787> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/32-175-jumbo-cable-ties-natural-ph-442025>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-32-x-6-x-750-air-foam-rolls-ph-541195 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-32-x-18-x-750-perforated-foam-rolls-ph-541181 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-32-x-72-x-750-air-foam-roll-ph-541199 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-32-x-72-x-750-perforated-foam-roll-ph-541201 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-3-4-x-1-7-8-10-pt-manila-shipping-tags-pre-strung-ph-422025 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/333-white-circle-laser-labels-ph-414449 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-3-4-x-1-7-8-13-pt-manila-shipping-tags-ph-422035 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-3-4-x-1-7-8-fluorescent-red-13-pt-shipping-tags-ph-423185 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-3-4-x-1-7-8-green-tyvek-shipping-tag-ph-424057 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-3-4-x-1-7-8-green-13-pt-shipping-tags-pre-wired-ph-423195 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/32-x-12-x-10-long-corrugated-boxes-ph-102787>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-32-x-48-x-750-perforated-foam-roll-ph-541193>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/32-x-1450-3-mil-poly-tubing-ph-353399> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/32-x-32-x-32-double-wall-boxes-ph-115469> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/32-x-32-x-8-flat-corrugated-boxes-ph-102805> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/32-x-48-2-mil-flat-poly-bag-ph-312408> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/32-x-50-1-1-2-mil-flat-poly-bag-ph-312387> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-12-160-edge-protectors-skid-lot-ph-462085 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-32-x-12-x-750-perforated-foam-rolls-ph-541177> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-32-x-6-x-750-air-foam-rolls-ph-541195> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-32-x-18-x-750-perforated-foam-rolls-ph-541181> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-18-225-edge-protectors-skid-lot-ph-462093 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-1-white-corrugated-mailers-ph-211103 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-3-4-x-1-7-8-light-blue-13-pt-shipping-tags-ph-423203>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/32-x-1450-3-mil-poly-tubing-ph-353399>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/32-x-32-x-32-double-wall-boxes-ph-115469>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/32-x-32-x-8-flat-corrugated-boxes-ph-102805>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-32-x-72-x-750-air-foam-roll-ph-541199> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-32-x-72-x-750-perforated-foam-roll-ph-541201> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-3-4-x-1-7-8-10-pt-manila-shipping-tags-pre-strung-ph-422025> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/333-white-circle-laser-labels-ph-414449> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/32-x-48-2-mil-flat-poly-bag-ph-312408>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/32-x-50-1-1-2-mil-flat-poly-bag-ph-312387>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-32-x-12-x-750-perforated-foam-rolls-ph-541177>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-36-225-edge-protectors-skid-lot-ph-462113>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-3-4-x-1-7-8-13-pt-manila-shipping-tags-ph-422035> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-3-4-x-1-7-8-fluorescent-red-13-pt-shipping-tags-ph-423185> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-3-4-x-1-7-8-green-tyvek-shipping-tag-ph-424057> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-3-4-x-1-7-8-green-13-pt-shipping-tags-pre-wired-ph-423195> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-32-x-6-x-750-air-foam-rolls-ph-541195>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-32-x-18-x-750-perforated-foam-rolls-ph-541181>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-24-120-edge-protectors-skid-lot-ph-462095 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-2-kraft-gift-box-ph-931105 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-30-kraft-square-mailing-tubes-ph-213485 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-30-white-square-mailing-tubes-ph-213487 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-32-x-72-x-750-air-foam-roll-ph-541199>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-32-x-72-x-750-perforated-foam-roll-ph-541201>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-3-4-x-1-7-8-10-pt-manila-shipping-tags-pre-strung-ph-422025>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/333-white-circle-laser-labels-ph-414449>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-48-225-edge-protectors-skid-lot-ph-462127>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-36-120-edge-protectors-cased-ph-461103 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-36-225-edge-protectors-cased-ph-461107 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-12-160-edge-protectors-skid-lot-ph-462085 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-3-4-x-1-7-8-13-pt-manila-shipping-tags-ph-422035>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-3-4-x-1-7-8-fluorescent-red-13-pt-shipping-tags-ph-423185>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-3-4-x-1-7-8-green-tyvek-shipping-tag-ph-424057>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-3-4-x-1-7-8-green-13-pt-shipping-tags-pre-wired-ph-423195>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-3-kraft-corrugated-mailers-ph-211109 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-3-white-gift-box-ph-931111 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-18-225-edge-protectors-skid-lot-ph-462093 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-1-white-corrugated-mailers-ph-211103 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-40-160-edge-protectors-cased-ph-461111 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-4-225-strapping-protectors-ph-463019 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-60-225-edge-protectors-cased-ph-461125 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-3-corrugated-boxes-ph-102811>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-72-120-edge-protectors-skid-lot-ph-462135 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-4-1-1-2-mil-resealable-poly-bag-ph-319103 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-4-1-2-clear-face-document-envelopes-ph-453005 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-4-1-mil-flat-poly-bag-ph-311127 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-24-120-edge-protectors-skid-lot-ph-462095 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-30-white-square-mailing-tubes-ph-213487 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-2-kraft-gift-box-ph-931105 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-6-225-strapping-protectors-ph-463023>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-36-120-edge-protectors-cased-ph-461103 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-36-225-edge-protectors-cased-ph-461107 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-x-3-x-12-160-edge-protectors-skid-lot-ph-462085> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-42-kraft-crimped-end-tubes-ph-213539 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-3-kraft-corrugated-mailers-ph-211109 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-3-white-gift-box-ph-931111 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-x-3-x-18-225-edge-protectors-skid-lot-ph-462093> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-x-3-x-1-white-corrugated-mailers-ph-211103> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-30-kraft-square-mailing-tubes-ph-213485>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-40-160-edge-protectors-cased-ph-461111 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-4-225-strapping-protectors-ph-463019 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-60-225-edge-protectors-cased-ph-461125 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-42-kraft-heavy-duty-tubes-with-caps-ph-213541 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-12-160-edge-protectors-skid-lot-ph-462085>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-3-x-72-120-edge-protectors-skid-lot-ph-462135 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-4-1-1-2-mil-resealable-poly-bag-ph-319103 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-4-1-2-clear-face-document-envelopes-ph-453005 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-4-1-mil-flat-poly-bag-ph-311127 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-18-225-edge-protectors-skid-lot-ph-462093>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-1-white-corrugated-mailers-ph-211103>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-x-3-x-24-120-edge-protectors-skid-lot-ph-462095> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-x-3-x-30-white-square-mailing-tubes-ph-213487> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-x-3-x-2-kraft-gift-box-ph-931105> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-4-2-mil-reclosable-poly-bag-w-hang-hole-ph-315217 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-x-3-x-36-120-edge-protectors-cased-ph-461103> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-x-3-x-36-225-edge-protectors-cased-ph-461107> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-42-kraft-crimped-end-tubes-ph-213539 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-1-4-x-2-1-8-white-13-pt-shipping-tags-pre-wired-ph-423303 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-x-3-x-3-kraft-corrugated-mailers-ph-211109> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-x-3-x-3-white-gift-box-ph-931111> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-1-4-x-2-1-8-yellow-13-pt-shipping-tags-pre-wired-ph-423309 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-1-4-x-2-1-8-yellow-tyvek-shipping-tag-ph-424097 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-24-120-edge-protectors-skid-lot-ph-462095>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-30-white-square-mailing-tubes-ph-213487>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-2-kraft-gift-box-ph-931105>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-x-3-x-40-160-edge-protectors-cased-ph-461111> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-x-3-x-4-225-strapping-protectors-ph-463019> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-x-3-x-60-225-edge-protectors-cased-ph-461125> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-42-kraft-heavy-duty-tubes-with-caps-ph-213541 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-36-120-edge-protectors-cased-ph-461103>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-36-225-edge-protectors-cased-ph-461107>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-x-3-x-72-120-edge-protectors-skid-lot-ph-462135> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-x-4-1-1-2-mil-resealable-poly-bag-ph-319103> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-x-4-1-2-clear-face-document-envelopes-ph-453005> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-x-4-1-mil-flat-poly-bag-ph-311127> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-3-kraft-corrugated-mailers-ph-211109>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-3-white-gift-box-ph-931111>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-1-4-x-5-1-2-white-rectangle-laser-labels-ph-414487 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-1-4-x-5-1-2-white-removable-rectangle-laser-labels-ph-414489 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-1-4-x-60-yds-3m-9458-adhesive-transfer-tape-ph-651391 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-x-4-2-mil-reclosable-poly-bag-w-hang-hole-ph-315217 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-40-160-edge-protectors-cased-ph-461111>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-4-225-strapping-protectors-ph-463019>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-60-225-edge-protectors-cased-ph-461125>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-1-4-x-7-white-rectangle-laser-labels-ph-414491 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-18-blue-cable-ties-ph-441001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-x-42-kraft-crimped-end-tubes-ph-213539> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-1-4-x-2-1-8-white-13-pt-shipping-tags-pre-wired-ph-423303 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-72-120-edge-protectors-skid-lot-ph-462135>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-4-1-1-2-mil-resealable-poly-bag-ph-319103>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-4-1-2-clear-face-document-envelopes-ph-453005>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-4-1-mil-flat-poly-bag-ph-311127>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-18-gray-cable-ties-ph-441025 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-1-4-x-2-1-8-yellow-13-pt-shipping-tags-pre-wired-ph-423309 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-1-4-x-2-1-8-yellow-tyvek-shipping-tag-ph-424097 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-18-green-cable-ties-ph-441029 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4--1-gallon-plastic-jug-foam-insert-ph-156199 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/42-x-32-x-72-2-mil-clear-pallet-covers-ph-351119 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-x-42-kraft-heavy-duty-tubes-with-caps-ph-213541> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-42-kraft-crimped-end-tubes-ph-213539>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/42-x-42-x-96-2-mil-clear-pallet-covers-ph-351127 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/433-x-1181-black-datamax-thermal-transfer-ribbons-ph-415161 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/433-x-984-black-zebra-thermal-transfer-ribbons-ph-415173 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-10-pt-manila-shipping-tags-ph-422053 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-18-fluorescent-green-cable-ties-ph-441005>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-1-4-x-5-1-2-white-rectangle-laser-labels-ph-414487 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-1-4-x-5-1-2-white-removable-rectangle-laser-labels-ph-414489 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-1-4-x-60-yds-3m-9458-adhesive-transfer-tape-ph-651391 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/3-x-4-2-mil-reclosable-poly-bag-w-hang-hole-ph-315217> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-42-kraft-heavy-duty-tubes-with-caps-ph-213541>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-1-4-x-7-white-rectangle-laser-labels-ph-414491 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-18-blue-cable-ties-ph-441001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-10-pt-manila-shipping-tags-pre-strung-ph-422049 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-1-4-x-2-1-8-white-13-pt-shipping-tags-pre-wired-ph-423303> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-accepted-green-inspection-tags-ph-425011 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-18-gray-cable-ties-ph-441025 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-1-4-x-2-1-8-yellow-13-pt-shipping-tags-pre-wired-ph-423309> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-1-4-x-2-1-8-yellow-tyvek-shipping-tag-ph-424097> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-4-2-mil-reclosable-poly-bag-w-hang-hole-ph-315217>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-18-green-cable-ties-ph-441029 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/42-x-32-x-72-2-mil-clear-pallet-covers-ph-351119 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-assorted-color-13-pt-shipping-tags-ph-423317 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-1-4-x-2-1-8-white-13-pt-shipping-tags-pre-wired-ph-423303>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/42-x-42-x-96-2-mil-clear-pallet-covers-ph-351127 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/433-x-1181-black-datamax-thermal-transfer-ribbons-ph-415161 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/433-x-984-black-zebra-thermal-transfer-ribbons-ph-415173 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-10-pt-manila-shipping-tags-ph-422053 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-1-4-x-2-1-8-yellow-13-pt-shipping-tags-pre-wired-ph-423309>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-1-4-x-2-1-8-yellow-tyvek-shipping-tag-ph-424097>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-1-4-x-5-1-2-white-rectangle-laser-labels-ph-414487> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-1-4-x-5-1-2-white-removable-rectangle-laser-labels-ph-414489> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-1-4-x-60-yds-3m-9458-adhesive-transfer-tape-ph-651391> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-blue-tyvek-shipping-tags-ph-424101 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4--1-gallon-plastic-jug-foam-insert-ph-156199>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-1-4-x-7-white-rectangle-laser-labels-ph-414491> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-18-blue-cable-ties-ph-441001> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-10-pt-manila-shipping-tags-pre-strung-ph-422049 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-claim-tag-numbered-strung-ph-428005 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-accepted-green-inspection-tags-ph-425011 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-18-gray-cable-ties-ph-441025> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-dark-blue-13-pt-shipping-tags-pre-wired-ph-423321 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-fluorescent-pink-13-pt-shipping-tags-ph-423341 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-1-4-x-5-1-2-white-rectangle-laser-labels-ph-414487>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-1-4-x-5-1-2-white-removable-rectangle-laser-labels-ph-414489>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-1-4-x-60-yds-3m-9458-adhesive-transfer-tape-ph-651391>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-18-green-cable-ties-ph-441029> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-fluor-green-13-pt-shipping-tag-strung-ph-423325 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/42-x-32-x-72-2-mil-clear-pallet-covers-ph-351119> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-assorted-color-13-pt-shipping-tags-ph-423317 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-1-4-x-7-white-rectangle-laser-labels-ph-414491>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-18-blue-cable-ties-ph-441001>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/42-x-42-x-96-2-mil-clear-pallet-covers-ph-351127> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/433-x-1181-black-datamax-thermal-transfer-ribbons-ph-415161> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/433-x-984-black-zebra-thermal-transfer-ribbons-ph-415173> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-3-4-x-2-3-8-10-pt-manila-shipping-tags-ph-422053> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-18-gray-cable-ties-ph-441025>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-fluor-orange-13-pt-shipping-tag-strung-ph-423331 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-fluor-pink-13-pt-shipping-tag-pre-strung-ph-423337 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-fluor-pink-13-pt-shipping-tags-pre-wired-ph-423339 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-blue-tyvek-shipping-tags-ph-424101 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-18-green-cable-ties-ph-441029>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/42-x-32-x-72-2-mil-clear-pallet-covers-ph-351119>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-5-2-mil-flat-poly-bag-ph-311241 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-3-4-x-2-3-8-10-pt-manila-shipping-tags-pre-strung-ph-422049> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-claim-tag-numbered-strung-ph-428005 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/42-x-42-x-96-2-mil-clear-pallet-covers-ph-351127>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/433-x-1181-black-datamax-thermal-transfer-ribbons-ph-415161>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/433-x-984-black-zebra-thermal-transfer-ribbons-ph-415173>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-3-4-x-2-3-8-10-pt-manila-shipping-tags-ph-422053>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-3-4-x-2-3-8-accepted-green-inspection-tags-ph-425011> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-5-32-orange-paper-twist-ties-ph-345137 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-5-32-red-paper-twist-ties-ph-345139 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-dark-blue-13-pt-shipping-tags-pre-wired-ph-423321 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-fluorescent-pink-13-pt-shipping-tags-ph-423341 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-5-32-red-plastic-twist-ties-ph-345281 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-fluor-green-13-pt-shipping-tag-strung-ph-423325 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-5-32-white-paper-twist-ties-ph-345141 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-3-4-x-2-3-8-10-pt-manila-shipping-tags-pre-strung-ph-422049>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-3-4-x-2-3-8-assorted-color-13-pt-shipping-tags-ph-423317> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-5-3-mil-flat-poly-bag-ph-311258 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-5-4-mil-anti-static-flat-poly-bag-ph-331195 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-3-4-x-2-3-8-accepted-green-inspection-tags-ph-425011>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-5-reclosable-static-shielding-bags-ph-334137>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-5-brown-waterhog-mat-ph-737227 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-fluor-orange-13-pt-shipping-tag-strung-ph-423331 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-fluor-pink-13-pt-shipping-tag-pre-strung-ph-423337 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-fluor-pink-13-pt-shipping-tags-pre-wired-ph-423339 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-3-4-x-2-3-8-blue-tyvek-shipping-tags-ph-424101> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-5-2-mil-flat-poly-bag-ph-311241 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-5-navy-waterhog-mat-ph-737231 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-3-4-x-2-3-8-claim-tag-numbered-strung-ph-428005> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-3-4-x-2-3-8-assorted-color-13-pt-shipping-tags-ph-423317>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-5-4-mil-reclosable-poly-bag-ph-315146>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-5-yds-clear-3m-f9473.c-vhb-tape-ph-696185 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-5-32-orange-paper-twist-ties-ph-345137 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-5-32-red-paper-twist-ties-ph-345139 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-3-4-x-2-3-8-dark-blue-13-pt-shipping-tags-pre-wired-ph-423321> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-3-4-x-2-3-8-fluorescent-pink-13-pt-shipping-tags-ph-423341> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-5-32-red-plastic-twist-ties-ph-345281 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-3-4-x-2-3-8-fluor-green-13-pt-shipping-tag-strung-ph-423325> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-5-32-white-paper-twist-ties-ph-345141 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-3-4-x-2-3-8-blue-tyvek-shipping-tags-ph-424101>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-3-4-x-2-3-8-claim-tag-numbered-strung-ph-428005>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-60-black-heavy-duty-anti-slip-tape-ph-631099 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-5-3-mil-flat-poly-bag-ph-311258 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-5-4-mil-anti-static-flat-poly-bag-ph-331195 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-60-forest-green-vinyl-carpet-mat-ph-737566 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-3-4-x-2-3-8-dark-blue-13-pt-shipping-tags-pre-wired-ph-423321>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-60-yds-3m-346-flatback-tape-ph-624107>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-5-brown-waterhog-mat-ph-737227 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-3-4-x-2-3-8-fluor-orange-13-pt-shipping-tag-strung-ph-423331> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-3-4-x-2-3-8-fluor-pink-13-pt-shipping-tag-pre-strung-ph-423337> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-3-4-x-2-3-8-fluor-pink-13-pt-shipping-tags-pre-wired-ph-423339> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-3-4-x-2-3-8-fluorescent-pink-13-pt-shipping-tags-ph-423341>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-3-4-x-2-3-8-fluor-green-13-pt-shipping-tag-strung-ph-423325>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-60-gray-3m-safety-walk-tape-370-ph-633055 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-5-2-mil-flat-poly-bag-ph-311241> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-5-navy-waterhog-mat-ph-737231 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-60-white-heavy-duty-anti-slip-tape-ph-631117 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-5-yds-clear-3m-f9473.c-vhb-tape-ph-696185 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-5-32-orange-paper-twist-ties-ph-345137> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-5-32-red-paper-twist-ties-ph-345139> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-60-yds-3m-9485c-adhesive-transfer-tape-ph-651395 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-3-4-x-2-3-8-fluor-orange-13-pt-shipping-tag-strung-ph-423331>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-3-4-x-2-3-8-fluor-pink-13-pt-shipping-tag-pre-strung-ph-423337>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-3-4-x-2-3-8-fluor-pink-13-pt-shipping-tags-pre-wired-ph-423339>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-60-yds-yellow-11-mil-gaffers-tape-ph-693157 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-5-32-red-plastic-twist-ties-ph-345281> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-1-1-2-mil-flat-poly-bag-ph-311255 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-5-32-white-paper-twist-ties-ph-345141> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-5-2-mil-flat-poly-bag-ph-311241>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-60-black-heavy-duty-anti-slip-tape-ph-631099 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-5-3-mil-flat-poly-bag-ph-311258> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-5-4-mil-anti-static-flat-poly-bag-ph-331195> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-60-forest-green-vinyl-carpet-mat-ph-737566 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-5-32-orange-paper-twist-ties-ph-345137>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-5-32-red-paper-twist-ties-ph-345139>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-5-brown-waterhog-mat-ph-737227> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-1-1-2-mil-resealable-poly-bag-ph-319107 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-1-1-2-mil-resealable-polypropylene-bags-ph-354149 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-1-2-white-thermal-transfer-labels-ph-415095 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-5-32-red-plastic-twist-ties-ph-345281>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-5-32-white-paper-twist-ties-ph-345141>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-60-gray-3m-safety-walk-tape-370-ph-633055 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-5-navy-waterhog-mat-ph-737231> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-60-white-heavy-duty-anti-slip-tape-ph-631117 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-5-3-mil-flat-poly-bag-ph-311258>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-5-4-mil-anti-static-flat-poly-bag-ph-331195>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-5-yds-clear-3m-f9473.c-vhb-tape-ph-696185> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-2-mil-blue-flat-poly-bag-ph-311244 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-2-mil-green-reclosable-poly-bag-ph-315102 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-60-yds-3m-9485c-adhesive-transfer-tape-ph-651395 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-5-brown-waterhog-mat-ph-737227>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-60-yds-yellow-11-mil-gaffers-tape-ph-693157 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-2-mil-minigrip-reclosable-poly-bag-ph-313153 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-1-1-2-mil-flat-poly-bag-ph-311255 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-2-mil-minigrip-white-block-reclosable-poly-bag-ph-313167 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-2-mil-anti-static-reclosable-poly-bag-ph-331133>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-5-navy-waterhog-mat-ph-737231>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-60-black-heavy-duty-anti-slip-tape-ph-631099> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-2-mil-reclosable-poly-bag-w-hang-hole-ph-315221 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-2-mil-red-flat-poly-bag-ph-311246 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-60-forest-green-vinyl-carpet-mat-ph-737566> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-5-yds-clear-3m-f9473.c-vhb-tape-ph-696185>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-3-mil-slide-seal-poly-bag-ph-315209>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-2-mil-white-block-reclosable-poly-bag-ph-317307 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-1-1-2-mil-resealable-polypropylene-bags-ph-354149 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-1-2-white-thermal-transfer-labels-ph-415095 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-60-gray-3m-safety-walk-tape-370-ph-633055> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-3-mil-flat-polypropylene-bags-ph-354169 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-3-mil-minigrip-reclosable-lab-guard-uv-bag-ph-313175 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-60-white-heavy-duty-anti-slip-tape-ph-631117> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-60-black-heavy-duty-anti-slip-tape-ph-631099>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-8-4-mil-anti-static-flat-poly-bag-ph-331215>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-60-forest-green-vinyl-carpet-mat-ph-737566>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/5-x-8-2-mil-minigrip-white-block-reclosable-poly-bag-ph-313185 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-2-mil-blue-flat-poly-bag-ph-311244 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-2-mil-green-reclosable-poly-bag-ph-315102 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-60-yds-3m-9485c-adhesive-transfer-tape-ph-651395> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-1-1-2-mil-resealable-poly-bag-ph-319107>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-60-yds-yellow-11-mil-gaffers-tape-ph-693157> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-2-mil-minigrip-reclosable-poly-bag-ph-313153 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-6-1-1-2-mil-flat-poly-bag-ph-311255> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-2-mil-minigrip-white-block-reclosable-poly-bag-ph-313167 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-60-gray-3m-safety-walk-tape-370-ph-633055>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-60-white-heavy-duty-anti-slip-tape-ph-631117>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/5-x-8-4-mil-poly-bag-on-a-roll-ph-314237 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-2-mil-reclosable-poly-bag-w-hang-hole-ph-315221 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-2-mil-red-flat-poly-bag-ph-311246 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/5-x-8-6-mil-reclosable-poly-bag-ph-315179 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-60-yds-3m-9485c-adhesive-transfer-tape-ph-651395>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-2-mil-white-block-reclosable-poly-bag-ph-317307 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/5-x-8-super-scan-press-on-vinyl-envelopes-ph-416283 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-6-1-1-2-mil-resealable-polypropylene-bags-ph-354149> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-6-1-2-white-thermal-transfer-labels-ph-415095> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-60-yds-yellow-11-mil-gaffers-tape-ph-693157>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-1-1-2-mil-flat-poly-bag-ph-311255>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/5-x-9-1-mil-flat-poly-bag-ph-311352 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-3-mil-flat-polypropylene-bags-ph-354169 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-x-6-3-mil-minigrip-reclosable-lab-guard-uv-bag-ph-313175 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/5-x-9-4-mil-flat-poly-bag-ph-311347 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/5-x-8-2-mil-minigrip-white-block-reclosable-poly-bag-ph-313185 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-6-2-mil-blue-flat-poly-bag-ph-311244> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-6-2-mil-green-reclosable-poly-bag-ph-315102> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-175-jumbo-cable-ties-natural-ph-442035 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-1-1-2-mil-resealable-polypropylene-bags-ph-354149>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60--40-lb-kraft-paper-rolls-ph-511203>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-1-2-white-thermal-transfer-labels-ph-415095>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/602-x-1476-black-zebra-thermal-transfer-ribbons-wax-ph-415189 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-6-2-mil-minigrip-reclosable-poly-bag-ph-313153> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60--30-lb-kraft-paper-rolls-ph-511201 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-6-2-mil-minigrip-white-block-reclosable-poly-bag-ph-313167> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/5-x-8-4-mil-poly-bag-on-a-roll-ph-314237 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-6-2-mil-reclosable-poly-bag-w-hang-hole-ph-315221> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-6-2-mil-red-flat-poly-bag-ph-311246> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/5-x-8-6-mil-reclosable-poly-bag-ph-315179 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-2-mil-blue-flat-poly-bag-ph-311244>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-2-mil-green-reclosable-poly-bag-ph-315102>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-6-2-mil-white-block-reclosable-poly-bag-ph-317307> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/5-x-8-super-scan-press-on-vinyl-envelopes-ph-416283 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60--50-lb-kraft-paper-rolls-ph-511205 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60--butcher-paper-rolls-ph-512137 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-2-mil-minigrip-reclosable-poly-bag-ph-313153>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-2-mil-minigrip-white-block-reclosable-poly-bag-ph-313167>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/5-x-9-1-mil-flat-poly-bag-ph-311352 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-6-3-mil-flat-polypropylene-bags-ph-354169> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/4-x-6-3-mil-minigrip-reclosable-lab-guard-uv-bag-ph-313175> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/5-x-9-4-mil-flat-poly-bag-ph-311347 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-2-mil-reclosable-poly-bag-w-hang-hole-ph-315221>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-2-mil-red-flat-poly-bag-ph-311246>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/5-x-8-2-mil-minigrip-white-block-reclosable-poly-bag-ph-313185> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60--waxed-paper-rolls-ph-512115 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-18-x-54-wire-shelving-add-on-unit-ph-715231 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-175-jumbo-cable-ties-natural-ph-442035 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-2-mil-white-block-reclosable-poly-bag-ph-317307>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/602-x-1476-black-zebra-thermal-transfer-ribbons-wax-ph-415189 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-18-x-74-wire-shelving-add-on-unit-ph-715239 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60--30-lb-kraft-paper-rolls-ph-511201 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-24-wire-shelf-2-pack-ph-715355 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-3-mil-flat-polypropylene-bags-ph-354169>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-3-mil-minigrip-reclosable-lab-guard-uv-bag-ph-313175>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/5-x-8-4-mil-poly-bag-on-a-roll-ph-314237> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-24-x-54-wire-shelving-add-on-unit-ph-715247 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-24-x-63-4-shelf-wire-shelving-ph-715249 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/5-x-8-6-mil-reclosable-poly-bag-ph-315179> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-8-2-mil-minigrip-white-block-reclosable-poly-bag-ph-313185>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-24-x-63-wire-shelving-add-on-unit-ph-715251 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/5-x-8-super-scan-press-on-vinyl-envelopes-ph-416283> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60--50-lb-kraft-paper-rolls-ph-511205 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60--butcher-paper-rolls-ph-512137 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/5-x-9-1-mil-flat-poly-bag-ph-311352> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-36-x-74-wire-shelving-add-on-unit-ph-715271 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-40-x-85-3-mil-clear-pallet-covers-ph-351305 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/5-x-9-4-mil-flat-poly-bag-ph-311347> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-8-4-mil-poly-bag-on-a-roll-ph-314237>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-8-6-mil-reclosable-poly-bag-ph-315179>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-60-3-mil-flat-poly-bag-ph-312500 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60--waxed-paper-rolls-ph-512115 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/60-175-jumbo-cable-ties-natural-ph-442035> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-8-super-scan-press-on-vinyl-envelopes-ph-416283>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/602-x-1476-black-zebra-thermal-transfer-ribbons-wax-ph-415189> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-18-x-74-wire-shelving-add-on-unit-ph-715239 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/60--30-lb-kraft-paper-rolls-ph-511201> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-24-wire-shelf-2-pack-ph-715355 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-9-1-mil-flat-poly-bag-ph-311352>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-9-4-mil-flat-poly-bag-ph-311347>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-60-6-mil-flat-poly-bag-ph-312501 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-24-x-54-wire-shelving-add-on-unit-ph-715247 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-24-x-63-4-shelf-wire-shelving-ph-715249 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-60-corrugated-sheets-ph-112341 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60-x-18-x-54-wire-shelving-add-on-unit-ph-715231>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60-175-jumbo-cable-ties-natural-ph-442035>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-24-x-63-wire-shelving-add-on-unit-ph-715251 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-60-goodwrappers-top-sheeting-ph-355113 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/60--50-lb-kraft-paper-rolls-ph-511205> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/60--butcher-paper-rolls-ph-512137> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/602-x-1476-black-zebra-thermal-transfer-ribbons-wax-ph-415189>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60--30-lb-kraft-paper-rolls-ph-511201>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-6-x-6-long-corrugated-boxes-ph-103055 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-36-x-74-wire-shelving-add-on-unit-ph-715271 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-40-x-85-3-mil-clear-pallet-covers-ph-351305 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-72-1-1-2-mil-clear-top-sheeting-ph-355115 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-60-3-mil-flat-poly-bag-ph-312500 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/60--waxed-paper-rolls-ph-512115> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-8-x-8-long-corrugated-boxes-ph-103057 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-96-corrugated-sheets-ph-112345 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60--50-lb-kraft-paper-rolls-ph-511205>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60--butcher-paper-rolls-ph-512137>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-blue-plastic-truck-seals-ph-491011 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/60-x-18-x-74-wire-shelving-add-on-unit-ph-715239> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-red-plastic-truck-seals-ph-491015 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/60-x-24-wire-shelf-2-pack-ph-715355> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-60-6-mil-flat-poly-bag-ph-312501 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/60-x-24-x-54-wire-shelving-add-on-unit-ph-715247> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/60-x-24-x-63-4-shelf-wire-shelving-ph-715249> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-60-corrugated-sheets-ph-112341 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60--waxed-paper-rolls-ph-512115>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/60-x-24-x-63-wire-shelving-add-on-unit-ph-715251> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-60-goodwrappers-top-sheeting-ph-355113 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-white-plastic-truck-seals-ph-491017 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-x-10-1-2-100-pack-poly-mailers-ph-221149 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60-x-18-x-74-wire-shelving-add-on-unit-ph-715239>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60-x-24-wire-shelf-2-pack-ph-715355>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-6-x-6-long-corrugated-boxes-ph-103055 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/60-x-36-x-74-wire-shelving-add-on-unit-ph-715271> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/60-x-40-x-85-3-mil-clear-pallet-covers-ph-351305> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-72-1-1-2-mil-clear-top-sheeting-ph-355115 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60-x-24-x-54-wire-shelving-add-on-unit-ph-715247>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60-x-24-x-63-4-shelf-wire-shelving-ph-715249>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/60-x-60-3-mil-flat-poly-bag-ph-312500> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-x-25-1-1-2-mil-doorknob-poly-bag-ph-321111 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-8-x-8-long-corrugated-boxes-ph-103057 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/60-x-96-corrugated-sheets-ph-112345 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60-x-24-x-63-wire-shelving-add-on-unit-ph-715251>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-blue-plastic-truck-seals-ph-491011 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-x-5-1-2-x-2-korrvu-retention-ph-121105 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-red-plastic-truck-seals-ph-491015 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-x-5-1-2-x-2-white-easy-fold-mailer-ph-211683 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60-x-36-x-74-wire-shelving-add-on-unit-ph-715271>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60-x-40-x-85-3-mil-clear-pallet-covers-ph-351305>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/60-x-60-6-mil-flat-poly-bag-ph-312501> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-x-5-1-2-yellow-return-documents-enclosed-envelopes-ph-455027 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-x-7-1-2-2-mil-flat-poly-bag-ph-311573 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/60-x-60-corrugated-sheets-ph-112341> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60-x-60-3-mil-flat-poly-bag-ph-312500>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-x-7-x-3-1-4-kraft-literature-mailer-ph-212369 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/60-x-60-goodwrappers-top-sheeting-ph-355113> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-white-plastic-truck-seals-ph-491017 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-x-10-1-2-100-pack-poly-mailers-ph-221149 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/60-x-6-x-6-long-corrugated-boxes-ph-103055> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-yellow-plastic-truck-seals-ph-491019 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-4-x-12-jiffy-tuffgard-extreme-bubble-mailer-ph-223101 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/60-x-72-1-1-2-mil-clear-top-sheeting-ph-355115> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/60-x-8-x-8-long-corrugated-boxes-ph-103057> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/60-x-96-corrugated-sheets-ph-112345> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60-x-60-6-mil-flat-poly-bag-ph-312501>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60-x-60-corrugated-sheets-ph-112341>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60-x-60-goodwrappers-top-sheeting-ph-355113>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60-x-6-x-6-long-corrugated-boxes-ph-103055>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60-x-72-1-1-2-mil-clear-top-sheeting-ph-355115>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-4-x-12-kraft-1-padded-mailers-ph-251115 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-x-25-1-1-2-mil-doorknob-poly-bag-ph-321111 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/7-1-2-blue-plastic-truck-seals-ph-491011> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/7-1-2-red-plastic-truck-seals-ph-491015> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-x-5-1-2-x-2-white-easy-fold-mailer-ph-211683 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-x-5-1-2-x-2-korrvu-retention-ph-121105 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-16-x-7000-signode-comparable-polypropylene-strapping-ph-472093 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-x-7-1-2-2-mil-flat-poly-bag-ph-311573 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-x-5-1-2-yellow-return-documents-enclosed-envelopes-ph-455027 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60-x-8-x-8-long-corrugated-boxes-ph-103057>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60-x-96-corrugated-sheets-ph-112345>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-x-7-x-3-1-4-kraft-literature-mailer-ph-212369 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/7-1-2-white-plastic-truck-seals-ph-491017> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-18-cable-ties-natural-ph-441047 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/7-1-2-x-10-1-2-100-pack-poly-mailers-ph-221149> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-1-2-blue-plastic-truck-seals-ph-491011>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-1-2-red-plastic-truck-seals-ph-491015>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-8-x-4-1-2-x-13-3-4-kraft-grocery-bag-ph-925133 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-2-yellow-plastic-truck-seals-ph-491019 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-4-x-12-jiffy-tuffgard-extreme-bubble-mailer-ph-223101 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/72mm-x-450-kraft-central-235-reinforced-tape-ph-623027 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-1-4-x-2-x-7-1-4-kraft-reverse-tuck-folding-cartons-ph-971349>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-4-x-12-kraft-1-padded-mailers-ph-251115 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/7-1-2-x-25-1-1-2-mil-doorknob-poly-bag-ph-321111> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/72mm-x-450-kraft-central-240-reinforced-tape-ph-623029 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/72mm-x-450-white-central-240-reinforced-tape-ph-623033 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-1-2-white-plastic-truck-seals-ph-491017>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-1-2-x-10-1-2-100-pack-poly-mailers-ph-221149>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/72-x-18-x-63-4-shelf-wire-shelving-ph-715281 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/7-1-2-x-5-1-2-x-2-white-easy-fold-mailer-ph-211683> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/7-1-2-x-5-1-2-x-2-korrvu-retention-ph-121105> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/72-x-18-x-86-4-shelf-wire-shelving-ph-715289 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-16-x-7000-signode-comparable-polypropylene-strapping-ph-472093 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/7-1-2-x-7-1-2-2-mil-flat-poly-bag-ph-311573> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/7-1-2-x-5-1-2-yellow-return-documents-enclosed-envelopes-ph-455027> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/72-x-18-x-86-wire-shelving-add-on-unit-ph-715291 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-1-2-x-25-1-1-2-mil-doorknob-poly-bag-ph-321111>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/7-1-2-x-7-x-3-1-4-kraft-literature-mailer-ph-212369> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/72-x-24-wire-shelves-2-pack-ph-715367 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-18-cable-ties-natural-ph-441047 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/72-x-24-x-74-wire-shelving-add-on-unit-ph-715303 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-1-2-x-5-1-2-x-2-white-easy-fold-mailer-ph-211683>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-1-2-x-5-1-2-x-2-korrvu-retention-ph-121105>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/7-1-8-x-4-1-2-x-13-3-4-kraft-grocery-bag-ph-925133 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/7-1-2-yellow-plastic-truck-seals-ph-491019> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/7-1-4-x-12-jiffy-tuffgard-extreme-bubble-mailer-ph-223101> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/72mm-x-450-kraft-central-235-reinforced-tape-ph-623027 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-1-2-x-7-1-2-2-mil-flat-poly-bag-ph-311573>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-1-2-x-5-1-2-yellow-return-documents-enclosed-envelopes-ph-455027>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-9-2-mil-reclosable-poly-bag-ph-315195>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/7-1-4-x-12-kraft-1-padded-mailers-ph-251115> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/72-x-80-camouflage-moving-blankets-ph-193101 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/72mm-x-450-kraft-central-240-reinforced-tape-ph-623029 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/72mm-x-450-white-central-240-reinforced-tape-ph-623033 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-1-2-x-7-x-3-1-4-kraft-literature-mailer-ph-212369>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/72-x-18-x-63-4-shelf-wire-shelving-ph-715281 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/72-x-80-deluxe-moving-blankets-ph-193103 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/72-x-18-x-86-4-shelf-wire-shelving-ph-715289 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-1-2-yellow-plastic-truck-seals-ph-491019>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-1-4-x-12-jiffy-tuffgard-extreme-bubble-mailer-ph-223101>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/7-16-x-7000-signode-comparable-polypropylene-strapping-ph-472093> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/8-x-8-x-8-white-corrugated-mailers-ph-211441 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-1-2-x-12-3-4-blue-metallic-glamour-mailer-ph-242227 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/72-x-18-x-86-wire-shelving-add-on-unit-ph-715291 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-1-4-x-12-kraft-1-padded-mailers-ph-251115>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-1-2-x-12-3-4-purple-metallic-glamour-mailer-ph-242233 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/72-x-24-wire-shelves-2-pack-ph-715367 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/7-18-cable-ties-natural-ph-441047> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/72-x-24-x-74-wire-shelving-add-on-unit-ph-715303 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-8-x-8-w5c-weather-resistant-shipper-ph-117009>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/7-1-8-x-4-1-2-x-13-3-4-kraft-grocery-bag-ph-925133> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-1-2-x-12-3-4-silver-metallic-glamour-mailer-ph-242237 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-1-2-x-12-clear-face-document-envelopes-ph-453089 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/72mm-x-450-kraft-central-235-reinforced-tape-ph-623027> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-16-x-7000-signode-comparable-polypropylene-strapping-ph-472093>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-1-2-x-14-1-2-jiffy-tuffgard-extreme-bubble-mailer-ph-223105 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/72-x-80-camouflage-moving-blankets-ph-193101 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/72mm-x-450-kraft-central-240-reinforced-tape-ph-623029> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/72mm-x-450-white-central-240-reinforced-tape-ph-623033> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-18-cable-ties-natural-ph-441047>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/72-x-18-x-63-4-shelf-wire-shelving-ph-715281> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/72-x-80-deluxe-moving-blankets-ph-193103 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-1-2-x-4-5-8-x-5-haz-mat-box-ph-151141 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/72-x-18-x-86-4-shelf-wire-shelving-ph-715289> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-1-8-x-4-1-2-x-13-3-4-kraft-grocery-bag-ph-925133>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/72mm-x-450-kraft-central-235-reinforced-tape-ph-623027>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-1-2-x-6-clear-face-document-envelopes-ph-453091 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/8-x-8-x-8-white-corrugated-mailers-ph-211441 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-1-2-x-12-3-4-blue-metallic-glamour-mailer-ph-242227 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/72-x-18-x-86-wire-shelving-add-on-unit-ph-715291> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/72mm-x-450-kraft-central-240-reinforced-tape-ph-623029>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/72mm-x-450-white-central-240-reinforced-tape-ph-623033>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-1-2-x-12-3-4-purple-metallic-glamour-mailer-ph-242233 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/72-x-24-wire-shelves-2-pack-ph-715367> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-1-2-x-6-white-utility-flat-mailers-ph-231159 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/72-x-24-x-74-wire-shelving-add-on-unit-ph-715303> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/72-x-18-x-63-4-shelf-wire-shelving-ph-715281>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/72-x-18-x-86-4-shelf-wire-shelving-ph-715289>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-1-4-x-14-1-2-kraft-clasp-envelopes-ph-281177 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-1-2-x-12-clear-face-document-envelopes-ph-453089 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-1-4-x-6-x-5-blue-stack-hang-bins-ph-711129 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/72-x-18-x-86-wire-shelving-add-on-unit-ph-715291>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-1-2-x-14-1-2-jiffy-tuffgard-extreme-bubble-mailer-ph-223105 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/72-x-80-camouflage-moving-blankets-ph-193101> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-1-4-x-6-x-5-green-stack-hang-bins-ph-711133 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/72-x-24-wire-shelves-2-pack-ph-715367>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/72-x-24-x-74-wire-shelving-add-on-unit-ph-715303>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9--30-lb-kraft-paper-rolls-ph-511103 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/72-x-80-deluxe-moving-blankets-ph-193103> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-1-2-x-4-5-8-x-5-haz-mat-box-ph-151141 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-1-2-x-12-3-4-silver-metallic-glamour-mailer-ph-242237>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-1-2-x-6-clear-face-document-envelopes-ph-453091 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/8-x-8-x-8-white-corrugated-mailers-ph-211441> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-1-2-x-12-3-4-blue-metallic-glamour-mailer-ph-242227> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-3-8-x-5-1-2-x-11-3-16-literature-counter-display-ph-911105 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/72-x-80-camouflage-moving-blankets-ph-193101>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-1-4-x-6-x-5-ivory-stack-hang-bins-ph-711139>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-1-2-x-12-3-4-purple-metallic-glamour-mailer-ph-242233> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-5-8-x-6-5-8-x-2-1-2-kraft-easy-fold-mailer-ph-211701 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-1-2-x-6-white-utility-flat-mailers-ph-231159 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-7-8-x-11-7-8-corrugated-layer-pads-ph-112357 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/72-x-80-deluxe-moving-blankets-ph-193103>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-3-4-x-12-1-4-white-flat-mailers-ph-231173>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-1-4-x-14-1-2-kraft-clasp-envelopes-ph-281177 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-7-8-x-3-plastic-shelf-bin-dividers-ph-712131 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-1-2-x-12-clear-face-document-envelopes-ph-453089> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-1-4-x-6-x-5-blue-stack-hang-bins-ph-711129 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-8-x-8-white-corrugated-mailers-ph-211441>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-1-2-x-12-3-4-blue-metallic-glamour-mailer-ph-242227>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-1-2-x-14-1-2-jiffy-tuffgard-extreme-bubble-mailer-ph-223105> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-blue-pull-tight-seals-ph-493001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-1-4-x-6-x-5-green-stack-hang-bins-ph-711133 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-green-pull-tight-seals-ph-493003 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-1-2-x-12-3-4-purple-metallic-glamour-mailer-ph-242233>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-11-1-2-red-glamour-bubble-mailers-ph-242143>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9--30-lb-kraft-paper-rolls-ph-511103 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-red-pull-tight-seals-ph-493005 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-1-2-x-4-5-8-x-5-haz-mat-box-ph-151141> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-x-11-1-2-blue-glamour-bubble-mailers-ph-242133 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-1-2-x-12-clear-face-document-envelopes-ph-453089>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-1-2-x-6-clear-face-document-envelopes-ph-453091> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-x-11-1-2-do-not-bend-flat-mailers-ph-231147 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-x-11-1-2-gold-glamour-bubble-mailers-ph-242135 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-3-8-x-5-1-2-x-11-3-16-literature-counter-display-ph-911105 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-1-2-x-14-1-2-jiffy-tuffgard-extreme-bubble-mailer-ph-223105>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-x-11-3-mil-flat-poly-bag-ph-311709 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-5-8-x-6-5-8-x-2-1-2-kraft-easy-fold-mailer-ph-211701 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-1-2-x-6-white-utility-flat-mailers-ph-231159> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-7-8-x-11-7-8-corrugated-layer-pads-ph-112357 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-1-2-x-4-5-8-x-5-haz-mat-box-ph-151141>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-1-4-x-14-1-2-kraft-clasp-envelopes-ph-281177> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-7-8-x-3-plastic-shelf-bin-dividers-ph-712131 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-x-12-2-mil-anti-static-flat-poly-bag-ph-331139 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-1-4-x-6-x-5-blue-stack-hang-bins-ph-711129> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-1-2-x-6-clear-face-document-envelopes-ph-453091>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-x-12-2-mil-anti-static-reclosable-poly-bag-ph-331185 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-blue-pull-tight-seals-ph-493001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-1-4-x-6-x-5-green-stack-hang-bins-ph-711133> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-green-pull-tight-seals-ph-493003 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-1-2-x-6-white-utility-flat-mailers-ph-231159>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9--30-lb-kraft-paper-rolls-ph-511103> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-x-12-2-mil-blue-reclosable-poly-bag-ph-315279 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-1-4-x-14-1-2-kraft-clasp-envelopes-ph-281177>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-1-4-x-6-x-5-blue-stack-hang-bins-ph-711129>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-x-12-2-mil-flat-poly-bag-ph-311711 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-x-11-1-2-do-not-bend-flat-mailers-ph-231147 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-x-11-1-2-gold-glamour-bubble-mailers-ph-242135 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-3-8-x-5-1-2-x-11-3-16-literature-counter-display-ph-911105> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-1-4-x-6-x-5-green-stack-hang-bins-ph-711133>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/metal-globe-truck-seals-white-ph-491007>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/nitrile-glove-accelerator-free-l-ph-891037>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-x-11-3-mil-flat-poly-bag-ph-311709 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-5-8-x-6-5-8-x-2-1-2-kraft-easy-fold-mailer-ph-211701> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-x-12-2-mil-flat-suffocation-warning-poly-bag-ph-335135 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-7-8-x-11-7-8-corrugated-layer-pads-ph-112357> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9--30-lb-kraft-paper-rolls-ph-511103>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-red-pull-tight-seals-ph-493005>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-11-1-2-blue-glamour-bubble-mailers-ph-242133>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/men-women-restroom-ada-compliant-plastic-sign-ph-781109 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-7-8-x-3-plastic-shelf-bin-dividers-ph-712131> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-x-12-2-mil-anti-static-flat-poly-bag-ph-331139 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/men-women-restrooms-9-x-6-facility-sign-ph-781149 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-3-8-x-5-1-2-x-11-3-16-literature-counter-display-ph-911105>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-x-12-2-mil-anti-static-reclosable-poly-bag-ph-331185 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-blue-pull-tight-seals-ph-493001> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-green-pull-tight-seals-ph-493003> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nitrile-glove-accelerator-free-m-ph-891035 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-5-8-x-6-5-8-x-2-1-2-kraft-easy-fold-mailer-ph-211701>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-7-8-x-11-7-8-corrugated-layer-pads-ph-112357>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nitrile-glove-extended-cuff-l-ph-891053 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nitrile-glove-extended-cuff-m-ph-891051 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-x-12-2-mil-blue-reclosable-poly-bag-ph-315279 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nitrile-glove-extended-cuff-s-ph-891049 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-7-8-x-3-plastic-shelf-bin-dividers-ph-712131>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-x-12-2-mil-flat-poly-bag-ph-311711 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-x-11-1-2-do-not-bend-flat-mailers-ph-231147> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-x-11-1-2-gold-glamour-bubble-mailers-ph-242135> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nitrile-gloves-6-mil-medium-ph-891191 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-blue-pull-tight-seals-ph-493001>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-green-pull-tight-seals-ph-493003>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-x-11-3-mil-flat-poly-bag-ph-311709> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nitrile-gloves-exam-grade-large-ph-891177 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/9-x-12-2-mil-flat-suffocation-warning-poly-bag-ph-335135 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nitrile-gloves-with-beaded-cuff-xlarge-ph-891225 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/men-women-restroom-ada-compliant-plastic-sign-ph-781109 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nitrile-gloves-with-extended-cuffs-l-ph-891217 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-x-12-2-mil-anti-static-flat-poly-bag-ph-331139> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/men-women-restrooms-9-x-6-facility-sign-ph-781149 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-11-1-2-do-not-bend-flat-mailers-ph-231147>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-11-1-2-gold-glamour-bubble-mailers-ph-242135>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-x-12-2-mil-anti-static-reclosable-poly-bag-ph-331185> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nitrile-gloves-with-extended-cuffs-s-ph-891213 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nitrile-gloves-with-extended-cuffs-xl-ph-891219 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nitrile-glove-accelerator-free-m-ph-891035 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-11-3-mil-flat-poly-bag-ph-311709>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nitrile-glove-extended-cuff-l-ph-891053 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nitrile-glove-extended-cuff-m-ph-891051 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-x-12-2-mil-blue-reclosable-poly-bag-ph-315279> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nitrile-glove-extended-cuff-s-ph-891049 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-12-2-mil-anti-static-flat-poly-bag-ph-331139>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/one-day-visitor-pass-ph-432021>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-x-12-2-mil-flat-poly-bag-ph-311711> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nylon-inspection-glove-womens-l-ph-891241 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/office-moving-kit-ph-192121 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nitrile-gloves-6-mil-medium-ph-891191 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-12-2-mil-anti-static-reclosable-poly-bag-ph-331185>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/office-trash-can-7-gallon-black-ph-744103 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nitrile-gloves-exam-grade-large-ph-891177 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/9-x-12-2-mil-flat-suffocation-warning-poly-bag-ph-335135> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nitrile-gloves-with-beaded-cuff-xlarge-ph-891225 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-12-2-mil-blue-reclosable-poly-bag-ph-315279>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/men-women-restroom-ada-compliant-plastic-sign-ph-781109> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nitrile-gloves-with-extended-cuffs-l-ph-891217 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/ph-449001-cable-tie-gun-ph-449001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/men-women-restrooms-9-x-6-facility-sign-ph-781149> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-12-2-mil-flat-poly-bag-ph-311711>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/ph-449009-cable-tie-gun-ph-449009 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nitrile-gloves-with-extended-cuffs-s-ph-891213 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nitrile-gloves-with-extended-cuffs-xl-ph-891219 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/nitrile-glove-accelerator-free-m-ph-891035> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-12-2-mil-flat-suffocation-warning-poly-bag-ph-335135>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/nitrile-glove-extended-cuff-l-ph-891053> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/nitrile-glove-extended-cuff-m-ph-891051> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/pigskin-leather-drivers-gloves-medium-ph-891283 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/nitrile-glove-extended-cuff-s-ph-891049> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/men-women-restroom-ada-compliant-plastic-sign-ph-781109>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/men-women-restrooms-9-x-6-facility-sign-ph-781149>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/pigskin-leather-drivers-gloves-xlarge-ph-891287 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/nylon-inspection-glove-womens-l-ph-891241 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/office-moving-kit-ph-192121 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/nitrile-gloves-6-mil-medium-ph-891191> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/nitrile-glove-accelerator-free-m-ph-891035>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/office-trash-can-7-gallon-black-ph-744103 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/nitrile-gloves-exam-grade-large-ph-891177> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/nitrile-gloves-with-beaded-cuff-xlarge-ph-891225> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/nitrile-glove-extended-cuff-l-ph-891053>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/nitrile-glove-extended-cuff-m-ph-891051>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/nitrile-glove-extended-cuff-s-ph-891049>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/plastic-clip-on-swivel-holster-ph-732165 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/nitrile-gloves-with-extended-cuffs-l-ph-891217> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/ph-449001-cable-tie-gun-ph-449001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/plastic-clip-on-swivel-safety-holster-ph-732153 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/nitrile-gloves-6-mil-medium-ph-891191>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/ph-449009-cable-tie-gun-ph-449009 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/nitrile-gloves-with-extended-cuffs-s-ph-891213> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/nitrile-gloves-with-extended-cuffs-xl-ph-891219> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/plastic-forks-ph-882000 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/nitrile-gloves-exam-grade-large-ph-891177>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/pink-anti-static-loose-fill-ph-551111>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/nitrile-gloves-with-beaded-cuff-xlarge-ph-891225>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/pvc-black-dot-knit-gloves-large-ph-891407 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/pvc-black-dot-knit-gloves-xlarge-ph-891409 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/pigskin-leather-drivers-gloves-medium-ph-891283 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/quickblade-spring-back-safety-knife-ph-732159 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/nitrile-gloves-with-extended-cuffs-l-ph-891217>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/pigskin-leather-drivers-gloves-xlarge-ph-891287 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/nylon-inspection-glove-womens-l-ph-891241> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/office-moving-kit-ph-192121> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/ranger-trash-can-45-gallon-2-way-black-ph-748107 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/nitrile-gloves-with-extended-cuffs-s-ph-891213>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/nitrile-gloves-with-extended-cuffs-xl-ph-891219>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/office-trash-can-7-gallon-black-ph-744103> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/ranger-trash-can-45-gallon-4-way-beige-ph-748101 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/red-sharpie-chisel-tip-markers-ph-734155 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/red-sharpie-fine-point-markers-ph-734129 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/plastic-clip-on-swivel-holster-ph-732165 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/red-sharpie-king-size-markers-ph-734141 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/ph-449001-cable-tie-gun-ph-449001> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/plastic-clip-on-swivel-safety-holster-ph-732153 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/nylon-inspection-glove-womens-l-ph-891241>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/office-moving-kit-ph-192121>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/ph-449009-cable-tie-gun-ph-449009> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/replacement-tape-cutting-blades-for-5-8-bag-taper-ph-343107 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/rubber-coated-palm-gloves-medium-ph-891431 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/plastic-forks-ph-882000 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/office-trash-can-7-gallon-black-ph-744103>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/pvc-black-dot-knit-gloves-large-ph-891407 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/pvc-black-dot-knit-gloves-xlarge-ph-891409 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/pigskin-leather-drivers-gloves-medium-ph-891283> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/quickblade-spring-back-safety-knife-ph-732159 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/ph-449001-cable-tie-gun-ph-449001>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/pigskin-leather-drivers-gloves-xlarge-ph-891287> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/rubbermaid-brute-dolly-ph-743123 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safegrip-glove-w-extended-beaded-cuff-m-ph-891339 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/ranger-trash-can-45-gallon-2-way-black-ph-748107 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/ph-449009-cable-tie-gun-ph-449009>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/11-1-4-x-8-3-4-x-10-heavy-duty-boxes-ph-115083 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/red-sharpie-chisel-tip-markers-ph-734155 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/ranger-trash-can-45-gallon-4-way-beige-ph-748101 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/red-sharpie-fine-point-markers-ph-734129 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/pigskin-leather-drivers-gloves-medium-ph-891283>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/plastic-clip-on-swivel-holster-ph-732165> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/red-sharpie-king-size-markers-ph-734141 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/11-1-4-x-8-3-4-x-12-multi-depth-shipper-ph-113153 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/plastic-clip-on-swivel-safety-holster-ph-732153> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/pigskin-leather-drivers-gloves-xlarge-ph-891287>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/11-1-4-x-8-3-4-x-12-white-corrugated-box-ph-111141 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/replacement-tape-cutting-blades-for-5-8-bag-taper-ph-343107 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/rubber-coated-palm-gloves-medium-ph-891431 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/plastic-forks-ph-882000> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/pvc-black-dot-knit-gloves-large-ph-891407> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/pvc-black-dot-knit-gloves-xlarge-ph-891409> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/11-1-8-x-8-3-4-x-2-5-16-white-literature-mailer-ph-212469 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/quickblade-spring-back-safety-knife-ph-732159> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/plastic-clip-on-swivel-holster-ph-732165>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/plastic-clip-on-swivel-safety-holster-ph-732153>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/11-1-8-x-8-3-4-x-2-kraft-deluxe-literature-mailer-ph-212149 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/rubbermaid-brute-dolly-ph-743123 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safegrip-glove-w-extended-beaded-cuff-m-ph-891339 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/ranger-trash-can-45-gallon-2-way-black-ph-748107> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/plastic-forks-ph-882000>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/11-1-4-x-8-3-4-x-10-heavy-duty-boxes-ph-115083 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/red-sharpie-chisel-tip-markers-ph-734155> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/ranger-trash-can-45-gallon-4-way-beige-ph-748101> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/red-sharpie-fine-point-markers-ph-734129> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/pvc-black-dot-knit-gloves-large-ph-891407>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/pvc-black-dot-knit-gloves-xlarge-ph-891409>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/quickblade-spring-back-safety-knife-ph-732159>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/11-1-8-x-8-3-4-x-3-white-deluxe-literature-mailer-ph-212155 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/red-sharpie-king-size-markers-ph-734141> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/11-1-4-x-8-3-4-x-12-multi-depth-shipper-ph-113153 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/ranger-trash-can-45-gallon-2-way-black-ph-748107>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/11-1-4-x-8-3-4-x-12-white-corrugated-box-ph-111141 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/replacement-tape-cutting-blades-for-5-8-bag-taper-ph-343107> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/rubber-coated-palm-gloves-medium-ph-891431> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/red-sharpie-chisel-tip-markers-ph-734155>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/ranger-trash-can-45-gallon-4-way-beige-ph-748101>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/red-sharpie-fine-point-markers-ph-734129>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/11-1-8-x-8-3-4-x-4-white-deluxe-literature-mailer-ph-212159 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/11-1-8-x-8-5-8-x-1-white-easy-fold-mailer-ph-211721 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/11-1-8-x-8-3-4-x-2-5-16-white-literature-mailer-ph-212469 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/11-1-8-x-8-5-8-x-2-1-2-side-loading-mailer-ph-212701 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/red-sharpie-king-size-markers-ph-734141>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-1-8-x-8-3-4-x-3-white-literature-mailer-ph-212471>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/11-1-8-x-8-3-4-x-2-kraft-deluxe-literature-mailer-ph-212149 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/rubbermaid-brute-dolly-ph-743123> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/safegrip-glove-w-extended-beaded-cuff-m-ph-891339> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/11-1-8-x-8-5-8-x-4-kraft-easy-fold-mailer-ph-211731 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/replacement-tape-cutting-blades-for-5-8-bag-taper-ph-343107>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/rubber-coated-palm-gloves-medium-ph-891431>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-1-8-x-8-3-4-x-4-white-cd-cd-packaging-ph-215107>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/11-1-4-x-8-3-4-x-10-heavy-duty-boxes-ph-115083> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-fluorescent-green-inventory-circle-labels-ph-412223 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-fluorescent-orange-circle-laser-labels-ph-414081 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-glossy-white-circle-laser-labels-ph-414111 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/11-1-8-x-8-3-4-x-3-white-deluxe-literature-mailer-ph-212155 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-metal-rim-tags-pre-strung-ph-426019 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/11-1-4-x-8-3-4-x-12-multi-depth-shipper-ph-113153> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-purple-inventory-circle-labels-ph-412259 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/rubbermaid-brute-dolly-ph-743123>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1-2-x-1-1-4-x-2-kraft-reverse-tuck-folding-cartons-ph-971109>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1-2-x-12-white-tubes-with-caps-ph-213105>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/safegrip-glove-w-extended-beaded-cuff-m-ph-891339>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/11-1-4-x-8-3-4-x-12-white-corrugated-box-ph-111141> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-white-circle-laser-labels-ph-414117 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-x-1-1-2-black-cable-tie-mounts-ph-449015 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-x-1-1-2-x-4-kraft-reverse-tuck-folding-cartons-ph-971105 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-1-4-x-8-3-4-x-10-heavy-duty-boxes-ph-115083>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/11-1-8-x-8-3-4-x-4-white-deluxe-literature-mailer-ph-212159 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/11-1-8-x-8-5-8-x-1-white-easy-fold-mailer-ph-211721 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/11-1-8-x-8-3-4-x-2-5-16-white-literature-mailer-ph-212469> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/11-1-8-x-8-5-8-x-2-1-2-side-loading-mailer-ph-212701 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-1-4-x-8-3-4-x-12-multi-depth-shipper-ph-113153>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/11-1-8-x-8-3-4-x-2-kraft-deluxe-literature-mailer-ph-212149> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-x-15-kraft-tubes-with-caps-ph-213109 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-x-15-white-tubes-with-caps-ph-213111 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/11-1-8-x-8-5-8-x-4-kraft-easy-fold-mailer-ph-211731 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-1-4-x-8-3-4-x-12-white-corrugated-box-ph-111141>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-x-16-kraft-tubes-with-caps-ph-213115 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-fluorescent-green-inventory-circle-labels-ph-412223 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-fluorescent-orange-circle-laser-labels-ph-414081 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-glossy-white-circle-laser-labels-ph-414111 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-1-8-x-8-3-4-x-2-5-16-white-literature-mailer-ph-212469>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/11-1-8-x-8-3-4-x-3-white-deluxe-literature-mailer-ph-212155> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-metal-rim-tags-pre-strung-ph-426019 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-purple-inventory-circle-labels-ph-412259 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-1-8-x-8-3-4-x-2-kraft-deluxe-literature-mailer-ph-212149>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-x-18-white-tubes-with-caps-ph-213123 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-x-1-1-2-black-cable-tie-mounts-ph-449015 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-white-circle-laser-labels-ph-414117 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-x-1-1-2-x-4-kraft-reverse-tuck-folding-cartons-ph-971105 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/11-1-8-x-8-3-4-x-4-white-deluxe-literature-mailer-ph-212159> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/11-1-8-x-8-5-8-x-1-white-easy-fold-mailer-ph-211721> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/11-1-8-x-8-5-8-x-2-1-2-side-loading-mailer-ph-212701> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-1-8-x-8-3-4-x-3-white-deluxe-literature-mailer-ph-212155>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1-2-x-16-white-tubes-with-caps-ph-213117>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-16-1-1-2-mil-flat-poly-bag-ph-311852>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-x-1-white-removable-rectangle-laser-labels-ph-414057 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-x-15-kraft-tubes-with-caps-ph-213109 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-x-15-white-tubes-with-caps-ph-213111 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/11-1-8-x-8-5-8-x-4-kraft-easy-fold-mailer-ph-211731> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-1-2-x-16-kraft-tubes-with-caps-ph-213115 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/1-1-2-fluorescent-green-inventory-circle-labels-ph-412223> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/1-1-2-fluorescent-orange-circle-laser-labels-ph-414081> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/1-1-2-glossy-white-circle-laser-labels-ph-414111> (failed 3 times): Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-1-8-x-8-3-4-x-4-white-deluxe-literature-mailer-ph-212159>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-1-8-x-8-5-8-x-1-white-easy-fold-mailer-ph-211721>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1-2-x-1-white-rectangle-laser-labels-master-case-ph-414045>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-1-8-x-8-5-8-x-2-1-2-side-loading-mailer-ph-212701>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-1-8-x-8-5-8-x-4-kraft-easy-fold-mailer-ph-211731>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1-2-fluorescent-green-inventory-circle-labels-ph-412223>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1-2-fluorescent-orange-circle-laser-labels-ph-414081>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1-2-glossy-white-circle-laser-labels-ph-414111>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
twisted.internet.error.ConnectionRefusedError: Connection was refused by other side: 111: Connection refused.
2025-11-01 08:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:30:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:31:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-14-x-6-multi-depth-corrugated-boxes-ph-113203>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:31:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 10698 pages (at 249 pages/min), scraped 4559 items (at 115 items/min)
2025-11-01 08:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:31:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-24-4-mil-white-block-reclosable-poly-bag-ph-317259>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:31:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:24 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-13-x-12-blue-space-age-totes-ph-716109> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-13-x-12-blue-space-age-totes-ph-716109 returned 404 status code.
2025-11-01 08:31:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:31:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-18-open-end-static-shielding-bags-ph-334377>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-18-x-14-corrugated-boxes-ph-101953>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:31:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:31:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:31:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:31:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:31:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:40 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 08:31:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:31:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/25-pk-bubble-lined-poly-mailers-ph-243123>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/26-x-12-x-12-long-corrugated-boxes-ph-102543>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:31:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/26-x-14-x-12-corrugated-boxes-ph-102547>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:31:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:31:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:31:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-packing-list-enclosed-labels-ph-411087>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:31:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:31:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 10977 pages (at 279 pages/min), scraped 4689 items (at 130 items/min)
2025-11-01 08:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-4-warning-hazardous-voltage-durable-safety-label-ph-414049> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-4-warning-hazardous-voltage-durable-safety-label-ph-414049 returned 404 status code.
2025-11-01 08:32:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/33-x-39-clear-can-liners-ph-751115> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/33-x-39-clear-can-liners-ph-751115 returned 404 status code.
2025-11-01 08:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/33-x-40-black-can-liners-ph-751161> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/33-x-40-black-can-liners-ph-751161 returned 404 status code.
2025-11-01 08:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:32:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:25 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:32:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-175-jumbo-cable-ties-natural-ph-442027>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:32:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-50-cable-ties-natural-ph-441191>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:32:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36--50-lb-yellow-kraft-paper-rolls-ph-511175>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:32:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-x-12-x-63-4-shelf-wire-shelving-ph-715109>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:32:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-450-warning-reinforced-water-activated-tape-ph-621009>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:32:29 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:32:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-450-white-central-260-reinforced-tape-ph-623015>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:32:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-48-kraft-crimped-end-tubes-ph-213547>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:32:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-4-do-not-freeze-labels-ph-411873>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:32:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-12-wire-shelves-ph-715327> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-12-wire-shelves-ph-715327 returned 404 status code.
2025-11-01 08:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:32:36 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:32:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:32:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:41 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-4-red-deluxe-vinyl-carpet-mat-ph-737464> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-4-red-deluxe-vinyl-carpet-mat-ph-737464 returned 404 status code.
2025-11-01 08:32:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:32:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/4-3-4-x-2-3-8-orange-13-pt-shipping-tags-pre-wired-ph-423375 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:32:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/46-x-38-x-36-octagon-bottom-tw-bulk-bin-ph-134103>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:32:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-dark-blue-inventory-rectangle-labels-ph-412755>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:32:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:32:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:58 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-6-charcoal-deluxe-vinyl-carpet-mat-ph-737474> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-6-charcoal-deluxe-vinyl-carpet-mat-ph-737474 returned 404 status code.
2025-11-01 08:32:58 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-6-blue-marble-anti-fatigue-mat-ph-737145> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-6-blue-marble-anti-fatigue-mat-ph-737145 returned 404 status code.
2025-11-01 08:32:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-resealable-clear-face-document-envelopes-ph-453023>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:32:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:32:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-two-up-arrows-over-bar-fluorescent-red-labels-ph-411277>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:01 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-6-red-black-waterhog-mat-ph-737238> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-6-red-black-waterhog-mat-ph-737238 returned 404 status code.
2025-11-01 08:33:01 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-6-forest-green-deluxe-vinyl-carpet-ph-737475> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-6-forest-green-deluxe-vinyl-carpet-ph-737475 returned 404 status code.
2025-11-01 08:33:01 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-1-2-x-9-1-2-kraft-clasp-envelopes-ph-281135>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-1-4-x-3-1-8-0000-0499-tag-3-part-carbonless-pre-wired-ph-425073>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-1-4-x-3-1-8-0000-0499-tag-carbonless-stub-style-wired-ph-425055>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-1-4-x-3-1-8-2500-2999-tags-3-part-carbonless-8-ph-425163>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-1-4-x-3-1-8-3000-3499-tag-carbonless-stub-style-wired-ph-425337>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 11274 pages (at 297 pages/min), scraped 4820 items (at 131 items/min)
2025-11-01 08:33:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/hook-and-loop-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-x-22-2-mil-flat-poly-bag-ph-311542>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-x-3-1-2-x-2-set-up-cartons-ph-991107>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-12-2-mil-white-reclosable-poly-bag-ph-315282>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:26 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-x-12-4-mil-minigrip-anti-static-reclosable-poly-bag-ph-313259> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-x-12-4-mil-minigrip-anti-static-reclosable-poly-bag-ph-313259 returned 404 status code.
2025-11-01 08:33:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-12-job-ticket-holders-assorted-ph-731157>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-12-resealable-suffocation-warning-vent-hole-ph-335131>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:28 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-12-x-2-kraft-expandable-self-seal-envelope-ph-281179>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-x-12-dual-pocket-job-ticket-holders-ph-731149> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-x-12-dual-pocket-job-ticket-holders-ph-731149 returned 404 status code.
2025-11-01 08:33:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-x-12-neon-red-job-ticket-holders-ph-731129> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-x-12-neon-red-job-ticket-holders-ph-731129 returned 404 status code.
2025-11-01 08:33:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:31 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-x-12-neon-pink-job-ticket-holders-ph-731127> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-x-12-neon-pink-job-ticket-holders-ph-731127 returned 404 status code.
2025-11-01 08:33:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:33 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-x-12-solid-back-job-ticket-holders-ph-731141> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-x-12-solid-back-job-ticket-holders-ph-731141 returned 404 status code.
2025-11-01 08:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:34 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/scott-1-ply-coreless-toliet-tissue-ph-821023> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/scott-1-ply-coreless-toliet-tissue-ph-821023 returned 404 status code.
2025-11-01 08:33:34 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-black-15-gal-ph-755103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-black-15-gal-ph-755103 returned 404 status code.
2025-11-01 08:33:34 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-black-33-gal-ph-755111> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-black-33-gal-ph-755111 returned 404 status code.
2025-11-01 08:33:34 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-black-40-45-gal-ph-755119> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-black-40-45-gal-ph-755119 returned 404 status code.
2025-11-01 08:33:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/safety-grip-utility-knife-neon-green-ph-732105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/safety-grip-utility-knife-neon-green-ph-732105 returned 404 status code.
2025-11-01 08:33:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-black-60-gal-ph-755143> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-black-60-gal-ph-755143 returned 404 status code.
2025-11-01 08:33:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-black-60-gal-ph-755145> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-black-60-gal-ph-755145 returned 404 status code.
2025-11-01 08:33:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/scott-surpass-2-ply-bathroom-tissue-ph-821005> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/scott-surpass-2-ply-bathroom-tissue-ph-821005 returned 404 status code.
2025-11-01 08:33:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/securit-retractable-key-holder-2-pack-ph-739101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/securit-retractable-key-holder-2-pack-ph-739101 returned 404 status code.
2025-11-01 08:33:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-black-6-bushel-ph-755137> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-black-6-bushel-ph-755137 returned 404 status code.
2025-11-01 08:33:36 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/shop-towels-14-x-14-red-5-lb-box-ph-827035> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/shop-towels-14-x-14-red-5-lb-box-ph-827035 returned 404 status code.
2025-11-01 08:33:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1-2-x-2-hot-bill-of-lading-flame-labels-ph-411009>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:36 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/slim-jim-paper-recycling-lid-23-gal-green-ph-742111> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/slim-jim-paper-recycling-lid-23-gal-green-ph-742111 returned 404 status code.
2025-11-01 08:33:36 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/shop-towels-14-x-14-red-25-lb-box-ph-827037> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/shop-towels-14-x-14-red-25-lb-box-ph-827037 returned 404 status code.
2025-11-01 08:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/404 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:37 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/square-recycling-slotted-lid-23-gal-blue-ph-742141> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/square-recycling-slotted-lid-23-gal-blue-ph-742141 returned 404 status code.
2025-11-01 08:33:37 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/slim-jimrecycling-bottle-and-can-lid-blue-ph-742101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/slim-jimrecycling-bottle-and-can-lid-blue-ph-742101 returned 404 status code.
2025-11-01 08:33:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:38 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/terry-cloth-towels-white-25-lb-box-ph-827039> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/terry-cloth-towels-white-25-lb-box-ph-827039 returned 404 status code.
2025-11-01 08:33:38 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/this-room-is-for-your-convenience-6-x-9-facility-sign-ph-781135> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/this-room-is-for-your-convenience-6-x-9-facility-sign-ph-781135 returned 404 status code.
2025-11-01 08:33:39 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/t1-tape-splitter-ph-732191> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/t1-tape-splitter-ph-732191 returned 404 status code.
2025-11-01 08:33:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:40 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/spring-back-safety-cutter-left-handed-ph-732111> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/spring-back-safety-cutter-left-handed-ph-732111 returned 404 status code.
2025-11-01 08:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/404 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-250-perfed-heavy-duty-bubble-roll-ph-531239 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-1-2-x-60-yds-3m-301+-masking-tape-ph-681631> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-1-2-x-60-yds-3m-301+-masking-tape-ph-681631 returned 404 status code.
2025-11-01 08:33:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-1-2-x-60-yds-3m-501+-masking-tape-ph-681633> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-1-2-x-60-yds-3m-501+-masking-tape-ph-681633 returned 404 status code.
2025-11-01 08:33:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-1-2-x-60-yds-8-pack-3m-401+-233+-masking-tape-ph-681637> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-1-2-x-60-yds-8-pack-3m-401+-233+-masking-tape-ph-681637 returned 404 status code.
2025-11-01 08:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/404 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-30-8-mil-flat-poly-bag-ph-312319 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-30-6-mil-flat-poly-bag-ph-312310 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/404> (failed 3 times): Invalid response, retrying...
2025-11-01 08:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/hook-and-loop-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:33:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-adhesive-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:33:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-4-x-4-kraft-corrugated-mailers-ph-211627>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-4-x-60-yds-yellow-masking-tape-ph-681125>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:58 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/specialty-tapes> (failed 3 times): Invalid response, retrying...
2025-11-01 08:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:33:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:01 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-8-x-18-x-550-air-foam-rolls-ph-541219>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:04 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:34:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-22-1-1-2-mil-flat-poly-bag-ph-311946> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-22-1-1-2-mil-flat-poly-bag-ph-311946 returned 404 status code.
2025-11-01 08:34:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-24-economy-tissue-ph-941125>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-24-open-end-static-shielding-bags-ph-334383>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:07 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:34:08 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:34:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-24-sm-pk-1-mil-flat-poly-bag-ph-311744>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 11616 pages (at 342 pages/min), scraped 4949 items (at 129 items/min)
2025-11-01 08:34:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/product-cushioning>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-30-metallic-silver-gift-grade-tissue-paper-ph-941173>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:09 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:34:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-30-tan-gift-grade-tissue-paper-ph-941193>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-27-green-waterhog-mat-ph-737169> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-27-green-waterhog-mat-ph-737169 returned 404 status code.
2025-11-01 08:34:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/26-x-26-x-8-flat-corrugated-boxes-ph-102615>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/26-x-36-3-mil-flat-poly-bag-ph-312334>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/28-x-18-x-18-double-wall-boxes-ph-115437>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:27 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-7-8-x-3-plastic-shelf-bin-dividers-ph-712125> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-7-8-x-3-plastic-shelf-bin-dividers-ph-712125 returned 404 status code.
2025-11-01 08:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:29 [py.warnings] (PID: 95) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2025-11-01 08:34:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-50-yds-fluorescent-pink-gaffers-ph-693051>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:30 [scrapy.extensions.feedexport] (PID: 95) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:5
2025-11-01 08:34:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:31 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/28-x-18-x-11-gray-brute-totes-with-lid-ph-717163> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/28-x-18-x-11-gray-brute-totes-with-lid-ph-717163 returned 404 status code.
2025-11-01 08:34:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-55-yds-blue-box-tape-ph-612133>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-55-yds-clear-220-industrial-tape-ph-612151>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-55-yds-crystal-clear-310cc-tape-ph-614045>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-18-yds-3m-926-adhesive-transfer-tape-ph-651311>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-20-yds-gray-10-pack-electrical-tape-ph-683127>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:43 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:44 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:45 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:45 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:34:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:45 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:34:45 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/vinyl-safety-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-18-x-54-4-shelf-wire-shelving-ph-715133> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-18-x-54-4-shelf-wire-shelving-ph-715133 returned 404 status code.
2025-11-01 08:34:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-x-24-x-54-wire-shelving-add-on-unit-ph-715167>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-18-x-54-wire-shelving-add-on-unit-ph-715137> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-18-x-54-wire-shelving-add-on-unit-ph-715137 returned 404 status code.
2025-11-01 08:34:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-24-x-74-4-shelf-wire-shelving-ph-715173> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-24-x-74-4-shelf-wire-shelving-ph-715173 returned 404 status code.
2025-11-01 08:34:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-24-wire-shelf-ph-715333> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-24-wire-shelf-ph-715333 returned 404 status code.
2025-11-01 08:34:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-55-yds-tan-291-industrial-tape-ph-612283>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:52 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-24-x-86-wire-shelving-add-on-unit-ph-715179> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-24-x-86-wire-shelving-add-on-unit-ph-715179 returned 404 status code.
2025-11-01 08:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-computer-material-enclosed-labels-ph-411585>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:34:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:56 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-5-brown-deluxe-entry-mat-ph-737451> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-5-brown-deluxe-entry-mat-ph-737451 returned 404 status code.
2025-11-01 08:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:57 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-5-brown-waterhog-mat-ph-737185> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-5-brown-waterhog-mat-ph-737185 returned 404 status code.
2025-11-01 08:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:03 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:35:03 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:35:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:04 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-12-wire-shelves-ph-715339> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-12-wire-shelves-ph-715339 returned 404 status code.
2025-11-01 08:35:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-12-x-63-wire-shelving-add-on-unit-ph-715187> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-12-x-63-wire-shelving-add-on-unit-ph-715187 returned 404 status code.
2025-11-01 08:35:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-12-x-54-wire-shelving-add-on-unit-ph-715183> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-12-x-54-wire-shelving-add-on-unit-ph-715183 returned 404 status code.
2025-11-01 08:35:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-12-x-86-wire-shelving-add-on-unit-ph-715195> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-12-x-86-wire-shelving-add-on-unit-ph-715195 returned 404 status code.
2025-11-01 08:35:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-18-x-86-4-shelf-wire-shelving-ph-715209> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-18-x-86-4-shelf-wire-shelving-ph-715209 returned 404 status code.
2025-11-01 08:35:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/48-x-2900-1-1-2-mil-poly-tubing-ph-353439>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 11994 pages (at 378 pages/min), scraped 5106 items (at 157 items/min)
2025-11-01 08:35:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/48-x-40-1-recycled-heat-treated-pallet-ph-484019>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-24-wire-shelf-ph-715345> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-24-wire-shelf-ph-715345 returned 404 status code.
2025-11-01 08:35:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-18-x-63-4-shelf-wire-shelving-ph-715201> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-18-x-63-4-shelf-wire-shelving-ph-715201 returned 404 status code.
2025-11-01 08:35:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-24-wire-shelves-4-pack-ph-715347> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-24-wire-shelves-4-pack-ph-715347 returned 404 status code.
2025-11-01 08:35:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-24-x-63-wire-shelving-add-on-unit-ph-715219> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-24-x-63-wire-shelving-add-on-unit-ph-715219 returned 404 status code.
2025-11-01 08:35:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-18-x-54-4-shelf-wire-shelving-ph-715197> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-18-x-54-4-shelf-wire-shelving-ph-715197 returned 404 status code.
2025-11-01 08:35:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-7-flush-cut-foam-pouches-ph-542115>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:09 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:35:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-24-x-86-4-shelf-wire-shelving-ph-715225> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-24-x-86-4-shelf-wire-shelving-ph-715225 returned 404 status code.
2025-11-01 08:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/hook-and-loop-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-24-x-74-4-shelf-wire-shelving-ph-715221> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-24-x-74-4-shelf-wire-shelving-ph-715221 returned 404 status code.
2025-11-01 08:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-8-brown-waterhog-mat-ph-737239> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-8-brown-waterhog-mat-ph-737239 returned 404 status code.
2025-11-01 08:35:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-1-4-x-3-1-8-4500-4999-tag-3-part-carbonless-pre-wired-ph-425233>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-1-4-x-3-1-8-6000-6999-tag-1-part-stub-style-pre-wired-ph-425261>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:19 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-1-2-x-10-red-border-airbill-envelope-document-envelope-ph-459005> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-1-2-x-10-red-border-airbill-envelope-document-envelope-ph-459005 returned 404 status code.
2025-11-01 08:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-1-4-x-3-1-8-dark-blue-13-pt-shipping-tags-ph-423575>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:24 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:35:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-x-5-1-2-upspap-ribbon-packing-list-enclosed-envelopes-ph-458013>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-x-7-x-12-tall-corrugated-boxes-ph-103145>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-x-7-x-5-white-corrugated-mailers-ph-211353>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/twin-toliet-tissue-dispenser-black-ph-821035>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/vermiculite-3a--coarse-ph-521105>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/wet-floor-safety-cone-4-sided-ph-836005>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/white-2-self-seal-padded-mailer-ph-251131>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/white-5-self-seal-bubble-mailers-ph-241249>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:38 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-m-ph-891389> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-m-ph-891389 returned 404 status code.
2025-11-01 08:35:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/women-restroom-ada-compliant-plastic-sign-ph-781107>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:38 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/vinyl-glove-3-mil-powder-free-s-ph-891355> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/vinyl-glove-3-mil-powder-free-s-ph-891355 returned 404 status code.
2025-11-01 08:35:39 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/vinyl-gloves-5-mil-powdered-l-ph-891367> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/vinyl-gloves-5-mil-powdered-l-ph-891367 returned 404 status code.
2025-11-01 08:35:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/wypall-x90-111-x-168-heavy-duty-wipers-ph-843067>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:39 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wet-floor-sign-2-sided-english-stand-ph-836001> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wet-floor-sign-2-sided-english-stand-ph-836001 returned 404 status code.
2025-11-01 08:35:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:40 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wooden-wet-floor-sign-2-sided-ph-836007> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wooden-wet-floor-sign-2-sided-ph-836007 returned 404 status code.
2025-11-01 08:35:40 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wypall-l40-164-x-98-all-purpose-wipers-ph-843025> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wypall-l40-164-x-98-all-purpose-wipers-ph-843025 returned 404 status code.
2025-11-01 08:35:40 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wypall-x60-91-x-168-wipers-dispenser-ph-844003> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wypall-x60-91-x-168-wipers-dispenser-ph-844003 returned 404 status code.
2025-11-01 08:35:40 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/white-marsh-88fx-metal-paint-markers-ph-734115> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/white-marsh-88fx-metal-paint-markers-ph-734115 returned 404 status code.
2025-11-01 08:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:41 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wypall-x60-wipers-bulk-pack-ph-844001> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wypall-x60-wipers-bulk-pack-ph-844001 returned 404 status code.
2025-11-01 08:35:41 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wypall-x80-red-heavy-duty-wipers-roll-ph-843057> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wypall-x80-red-heavy-duty-wipers-roll-ph-843057 returned 404 status code.
2025-11-01 08:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:41 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/white-mean-streak-paint-in-a-tube-ph-734161> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/white-mean-streak-paint-in-a-tube-ph-734161 returned 404 status code.
2025-11-01 08:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:41 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wypall-l30-economy-10-x-98-wipers-dispenser-ph-843011> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wypall-l30-economy-10-x-98-wipers-dispenser-ph-843011 returned 404 status code.
2025-11-01 08:35:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-8-3-8-x-4-green-shelf-bins-ph-711329> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-8-3-8-x-4-green-shelf-bins-ph-711329 returned 404 status code.
2025-11-01 08:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-2-3-4-x-4-yellow-shelf-bins-ph-711303> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-2-3-4-x-4-yellow-shelf-bins-ph-711303 returned 404 status code.
2025-11-01 08:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/packaging-industry-update-march-2021 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-8-3-8-x-4-yellow-shelf-bins-ph-711333> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-8-3-8-x-4-yellow-shelf-bins-ph-711333 returned 404 status code.
2025-11-01 08:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:45 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-4-1-8-x-4-blue-shelf-bins-ph-711305> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-4-1-8-x-4-blue-shelf-bins-ph-711305 returned 404 status code.
2025-11-01 08:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/packaging-industry-update-march-2021 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-5800-16-x-6-core-polyester-strapping-smooth-ph-473017>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/gusseted-poly-bags>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/packaging-industry-update-march-2021> (failed 3 times): Invalid response, retrying...
2025-11-01 08:35:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-60ga-reynolon-5044-pvc-shrink-film-ph-383123>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-60-yds-3m-301-masking-tape-ph-681159>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-60-yds-3m-8934-strapping-tape-ph-642045>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/aluminum-foil-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/15-x-11-x-7-corrugated-boxes-ph-101591>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:35:59 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:35:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:00 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:00 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:01 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:01 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/15-x-18-flush-cut-foam-pouches-ph-542151>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:04 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:05 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:05 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-30-6-mil-anti-static-flat-poly-bag-ph-331357>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:07 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-30-4-mil-reclosable-poly-bag-ph-315618> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-30-4-mil-reclosable-poly-bag-ph-315618 returned 404 status code.
2025-11-01 08:36:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 12368 pages (at 374 pages/min), scraped 5255 items (at 149 items/min)
2025-11-01 08:36:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:11 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-75ga-reynolon-5044-pvc-shrink-film-ph-383151>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/19-x-12-x-3-white-apparel-box-ph-961115>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:16 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-8-1-4-x-9-yellow-stack-hang-bins-ph-711267> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-8-1-4-x-9-yellow-stack-hang-bins-ph-711267 returned 404 status code.
2025-11-01 08:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:18 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:18 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2--1-gallon-plastic-jug-foam-insert-ph-156197>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/22-1-2-x-24-1-2-black-can-liners-ph-751139>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/28-x-40-3-mil-flat-poly-bag-ph-312337>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-5-yds-white-3m-4945-vhb-tape-ph-696181>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-60-yds-3m-201+-masking-tape-ph-681707> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-60-yds-3m-201+-masking-tape-ph-681707 returned 404 status code.
2025-11-01 08:36:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-60-yds-3m-401+-233+-masking-tape-ph-681751> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-60-yds-3m-401+-233+-masking-tape-ph-681751 returned 404 status code.
2025-11-01 08:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-5-yds-clear-3m-4910-vhb-tape-ph-696071>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/carton-sealing-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/double-sided-foam-tape-roll>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-4-x-60-yds-3m-401+-233+-masking-tape-ph-681339> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-4-x-60-yds-3m-401+-233+-masking-tape-ph-681339 returned 404 status code.
2025-11-01 08:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/safety-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/strapping-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/safety-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/strapping-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-x-72-corrugated-sheets-ph-112265>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-x-8-x-19-bench-rack-bin-organizer-ph-714101>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:55 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-58-clear-can-liners-ph-751131> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-58-clear-can-liners-ph-751131 returned 404 status code.
2025-11-01 08:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:56 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-58-black-can-liners-ph-751185> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-58-black-can-liners-ph-751185 returned 404 status code.
2025-11-01 08:36:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-8-3240-lb-white-twisted-nylon-rope-ph-476099>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:56 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:57 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:58 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:58 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:36:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:36:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:00 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:37:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:00 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:37:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:00 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:37:01 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:37:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-reclosable-static-shielding-bags-ph-334123>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 12752 pages (at 384 pages/min), scraped 5400 items (at 145 items/min)
2025-11-01 08:37:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/48-x-96-x-1-honeycomb-sheets-ph-482009>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:25 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-1-8-x-2-3-4-x-3-blue-shelf-bin-cups-ph-713105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-1-8-x-2-3-4-x-3-blue-shelf-bin-cups-ph-713105 returned 404 status code.
2025-11-01 08:37:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-corrugated-bin-divider-ph-175103>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-shelf-wire-shelving-with-red-bins-ph-715143>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-10-4-mil-white-block-reclosable-poly-bag-ph-317145>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:32 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-shelf-wire-shelving-with-blue-bins-ph-715135> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-shelf-wire-shelving-with-blue-bins-ph-715135 returned 404 status code.
2025-11-01 08:37:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:33 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-shelf-wire-shelving-with-yellow-bins-ph-715131> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-shelf-wire-shelving-with-yellow-bins-ph-715131 returned 404 status code.
2025-11-01 08:37:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-1-4-x-5-5-16-x-16-1-8-kraft-hardware-bag-ph-924121>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:38 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/8-1-2-x-14-1-2-kraft-3-padded-mailers-ph-251135> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/8-1-2-x-14-1-2-kraft-3-padded-mailers-ph-251135 returned 404 status code.
2025-11-01 08:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-40-green-cable-ties-ph-441117>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-18-3-mil-flat-poly-bag-ph-311735>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-7-x-4-corrugated-boxes-ph-103279>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/product/34644>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/product/34651>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-50-natural-releasable-cable-ties-ph-447011>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-red-stack-hang-bin-ph-711179>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:37:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:58 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-1-8-x-3-3-4-stack-hang-dividers-ph-712111> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-1-8-x-3-3-4-stack-hang-dividers-ph-712111 returned 404 status code.
2025-11-01 08:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:37:59 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-yellow-stack-hang-bin-ph-711155> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-yellow-stack-hang-bin-ph-711155 returned 404 status code.
2025-11-01 08:38:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-lb-orange-crinkle-paper-ph-951155>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:01 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-clear-stack-hang-bin-ph-711173> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-clear-stack-hang-bin-ph-711173 returned 404 status code.
2025-11-01 08:38:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:02 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-yellow-stack-hang-bin-ph-711183> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-yellow-stack-hang-bin-ph-711183 returned 404 status code.
2025-11-01 08:38:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:05 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-green-stack-hang-bin-ph-711147> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-green-stack-hang-bin-ph-711147 returned 404 status code.
2025-11-01 08:38:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-x-14-job-ticket-holders-ph-731111> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-x-14-job-ticket-holders-ph-731111 returned 404 status code.
2025-11-01 08:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 13095 pages (at 343 pages/min), scraped 5557 items (at 157 items/min)
2025-11-01 08:38:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-x-14-solid-back-job-ticket-holders-ph-731135> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-x-14-solid-back-job-ticket-holders-ph-731135 returned 404 status code.
2025-11-01 08:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-72-yds-3m-40-anti-static-tape-ph-645003>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:20 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:22 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/specialty-tapes>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:25 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/specialty-tapes> (failed 3 times): Invalid response, retrying...
2025-11-01 08:38:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:28 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:38:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-circle-tue-fluorescent-pink-days-of-the-week-labels-ph-412177>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:29 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/16-x-11-x-8-clear-stack-hang-bins-ph-711243> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/16-x-11-x-8-clear-stack-hang-bins-ph-711243 returned 404 status code.
2025-11-01 08:38:29 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/16-x-11-x-8-green-stack-hang-bins-ph-711245> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/16-x-11-x-8-green-stack-hang-bins-ph-711245 returned 404 status code.
2025-11-01 08:38:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:34 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-12-x-12-white-soft-foam-sheets-ph-546121>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/16-x-10-x-8-7-8-red-stack-nest-bin-ph-717111> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/16-x-10-x-8-7-8-red-stack-nest-bin-ph-717111 returned 404 status code.
2025-11-01 08:38:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-150-clear-3m-dual-lock-fasteners-ph-674063>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:37 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/22-x-22-100ga-shrink-bags-ph-381155>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/22-x-60ga-x-4375-poly-olefin-shrink-film-ph-384125>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-heavy-duty-strapping-tape-dispenser-ph-618057>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/hook-and-loop-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-10-2-mil-flat-poly-bag-ph-311080>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-110-yds-clear-291-industrial-tape-ph-612055>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:51 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-60-yds-black-10-mil-duct-tape-ph-682023>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:52 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-110-yds-clear-3m-3199-security-tape-ph-616041> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-110-yds-clear-3m-3199-security-tape-ph-616041 returned 404 status code.
2025-11-01 08:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:53 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-10-black-yellow-anti-fatigue-mat-ph-737339> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-10-black-yellow-anti-fatigue-mat-ph-737339 returned 404 status code.
2025-11-01 08:38:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/strapping-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/carton-sealing-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:56 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:38:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-60-yellow-heavy-duty-anti-slip-tape-ph-631081>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-6-gold-tubes-with-caps-ph-213307>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-6-plastic-label-holder-insert-cards-ph-418081>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-6-walnut-marble-anti-fatigue-mat-ph-737116>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/38-x-60-6-mil-flat-poly-bag-ph-312424>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:01 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:39:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:01 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/39-x-56-sure-sak-can-liners-ph-752107> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/39-x-56-sure-sak-can-liners-ph-752107 returned 404 status code.
2025-11-01 08:39:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/duct-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:03 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:39:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3m-501-filter-retainer-ph-723101>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/duct-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:03 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:39:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3m-h12-strapping-tape-dispenser-ph-618013>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:04 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-super-scan-press-on-vinyl-envelopes-ph-416261>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:07 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:39:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3m-8200-dust-respirator-ph-723113> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3m-8200-dust-respirator-ph-723113 returned 404 status code.
2025-11-01 08:39:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 13474 pages (at 379 pages/min), scraped 5711 items (at 154 items/min)
2025-11-01 08:39:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:08 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3m-6300-half-face-respirator-large-ph-723111> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3m-6300-half-face-respirator-large-ph-723111 returned 404 status code.
2025-11-01 08:39:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-60-yds-burgundy-11-mil-gaffers-tape-ph-693119>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-60-forest-green-vinyl-carpet-mat-ph-737546> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-60-forest-green-vinyl-carpet-mat-ph-737546 returned 404 status code.
2025-11-01 08:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:14 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/52-x-48-x-60-3-mil-clear-pallet-covers-ph-351259>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/52-x-60-4-mil-flat-poly-bag-ph-312492>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:17 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:39:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:17 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-12-brown-waterhog-mat-ph-737251> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-12-brown-waterhog-mat-ph-737251 returned 404 status code.
2025-11-01 08:39:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/safety-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:18 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-10-green-waterhog-mat-ph-737247> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-10-green-waterhog-mat-ph-737247 returned 404 status code.
2025-11-01 08:39:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-3-4-x-2-7-8-orange-13-pt-shipping-tags-pre-wired-ph-423537>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:21 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-18-6-mil-reclosable-poly-bag-ph-315379> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-18-6-mil-reclosable-poly-bag-ph-315379 returned 404 status code.
2025-11-01 08:39:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:21 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:39:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:22 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:39:22 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-black-stack-hang-bin-ph-711107> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-black-stack-hang-bin-ph-711107 returned 404 status code.
2025-11-01 08:39:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-12-2-mil-poly-bag-on-a-roll-ph-314261>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:23 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-blue-stack-hang-bin-ph-711101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-blue-stack-hang-bin-ph-711101 returned 404 status code.
2025-11-01 08:39:23 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-red-stack-hang-bins-ph-711109> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-red-stack-hang-bins-ph-711109 returned 404 status code.
2025-11-01 08:39:24 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-yellow-stack-hang-bin-ph-711113> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-yellow-stack-hang-bin-ph-711113 returned 404 status code.
2025-11-01 08:39:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:29 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-20-medium-gray-waterhog-runner-ph-737302> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-20-medium-gray-waterhog-runner-ph-737302 returned 404 status code.
2025-11-01 08:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-2-x-2-white-corrugated-mailers-ph-211201>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-impulse-sealer-with-cutter-ph-344111>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-oz-tech-pack-moisture-safe-ph-183139>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-1000-2-mil-polypropylene-tubing-ph-354319>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-30-4-mil-reclosable-poly-bag-ph-315367> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-30-4-mil-reclosable-poly-bag-ph-315367 returned 404 status code.
2025-11-01 08:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-10-2-mil-white-reclosable-poly-bag-ph-315274>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:37 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/8-shelf-wire-shelving-with-blue-bins-ph-715103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/8-shelf-wire-shelving-with-blue-bins-ph-715103 returned 404 status code.
2025-11-01 08:39:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/best-7500-nitrile-gloves-medium-ph-891131>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/best-nighthawk-nitrile-gloves-large-ph-891045> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/best-nighthawk-nitrile-gloves-large-ph-891045 returned 404 status code.
2025-11-01 08:39:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/brute-flat-trash-can-lid-32-gallon-blue-ph-743211>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-10-2-mil-flat-poly-bag-ph-311986>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/black-sharpie-king-size-markers-ph-734139> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/black-sharpie-king-size-markers-ph-734139 returned 404 status code.
2025-11-01 08:39:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/blue-marsh-88fx-metal-paint-markers-ph-734107> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/blue-marsh-88fx-metal-paint-markers-ph-734107 returned 404 status code.
2025-11-01 08:39:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/auto-retracting-swivel-holster-ph-732157> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/auto-retracting-swivel-holster-ph-732157 returned 404 status code.
2025-11-01 08:39:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/bkb-18-13-pt-snap-blades-ph-732185> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/bkb-18-13-pt-snap-blades-ph-732185 returned 404 status code.
2025-11-01 08:39:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-10-x-3-flat-corrugated-boxes-ph-101021>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/box-of-rags-standard-10-lb-box-ph-827019> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/box-of-rags-standard-10-lb-box-ph-827019 returned 404 status code.
2025-11-01 08:39:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/black-super-sharpie-markers-ph-734133> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/black-super-sharpie-markers-ph-734133 returned 404 status code.
2025-11-01 08:39:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/blue-spring-back-pocket-safety-cutter-ph-732179> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/blue-spring-back-pocket-safety-cutter-ph-732179 returned 404 status code.
2025-11-01 08:39:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-flat-trash-can-lid-44-gallon-blue-ph-743245> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-flat-trash-can-lid-44-gallon-blue-ph-743245 returned 404 status code.
2025-11-01 08:39:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/blue-sharpie-fine-point-markers-ph-734119> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/blue-sharpie-fine-point-markers-ph-734119 returned 404 status code.
2025-11-01 08:39:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:49 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-flat-trash-can-lid-20-gallon-red-ph-743181> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-flat-trash-can-lid-20-gallon-red-ph-743181 returned 404 status code.
2025-11-01 08:39:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-12-4-mil-vci-reclosable-poly-bag-ph-336133>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-1-8-x-9-1-4-x-5-white-deluxe-literature-mailer-ph-212215>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-1-8-x-9-1-8-x-3-kraft-easy-fold-mailer-ph-211763>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:39:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-8-x-2-3-4-white-deluxe-literature-mailer-ph-212199>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-8-x-24-3-mil-gusseted-poly-bag-ph-318423>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/hook-and-loop-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 13838 pages (at 364 pages/min), scraped 5867 items (at 156 items/min)
2025-11-01 08:40:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-12-x-4-kraft-deluxe-literature-mailer-ph-212273>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-16-x-26-tall-corrugated-boxes-ph-101739>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/hook-and-loop-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-36-yds-red-white-striped-vinyl-safety-tape-ph-631115>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-3-4-x-1-3-8-red-tyvek-shipping-tag-ph-424017>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:35 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:35 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:36 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/23-5-8-x-6-5-8-x-4-green-shelf-bins-ph-711395> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/23-5-8-x-6-5-8-x-4-green-shelf-bins-ph-711395 returned 404 status code.
2025-11-01 08:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:37 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/23-5-8-x-8-3-8-x-4-blue-shelf-bins-ph-711401> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/23-5-8-x-8-3-8-x-4-blue-shelf-bins-ph-711401 returned 404 status code.
2025-11-01 08:40:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24--40-lb-kraft-paper-rolls-ph-511141>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:37 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/23-5-8-x-6-5-8-x-4-yellow-shelf-bins-ph-711399> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/23-5-8-x-6-5-8-x-4-yellow-shelf-bins-ph-711399 returned 404 status code.
2025-11-01 08:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:38 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:40:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:38 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/23-5-8-x-11-1-8-x-4-green-shelf-bins-ph-711413> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/23-5-8-x-11-1-8-x-4-green-shelf-bins-ph-711413 returned 404 status code.
2025-11-01 08:40:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-100ga-2625-poly-olefin-shrink-film-ph-384167>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:39 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/23-x-33-black-can-liners-ph-751145> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/23-x-33-black-can-liners-ph-751145 returned 404 status code.
2025-11-01 08:40:39 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/23-5-8-x-8-3-8-x-4-green-shelf-bins-ph-711405> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/23-5-8-x-8-3-8-x-4-green-shelf-bins-ph-711405 returned 404 status code.
2025-11-01 08:40:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-12-gold-tubes-with-caps-ph-213161>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:40:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-8-1-1-2-mil-flat-poly-bag-ph-311042>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-8-up-handle-with-care-arrow-labels-ph-411687>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:40:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:54 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3.27-x-1476-black-zebra-thermal-transfer-ribbons-wax-ph-415139> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3.27-x-1476-black-zebra-thermal-transfer-ribbons-wax-ph-415139 returned 404 status code.
2025-11-01 08:40:54 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3.50-x-1181-black-datamax-thermal-transfer-ribbons-wax-ph-415143> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3.50-x-1181-black-datamax-thermal-transfer-ribbons-wax-ph-415143 returned 404 status code.
2025-11-01 08:40:54 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3.15-x-984-black-zebra-thermal-transfer-ribbons-wax-ph-415133> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3.15-x-984-black-zebra-thermal-transfer-ribbons-wax-ph-415133 returned 404 status code.
2025-11-01 08:40:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/30-x-24-x-20-corrugated-boxes-ph-102753>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:57 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:40:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:57 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:58 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:40:58 [py.warnings] (PID: 95) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2025-11-01 08:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:59 [scrapy.extensions.feedexport] (PID: 95) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:6
2025-11-01 08:40:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:40:59 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:40:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:01 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-10-brown-waterhog-mat-ph-737203> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-10-brown-waterhog-mat-ph-737203 returned 404 status code.
2025-11-01 08:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:01 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:41:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/carton-sealing-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:05 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-6-8-mil-reclosable-poly-bag-ph-315192> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-6-8-mil-reclosable-poly-bag-ph-315192 returned 404 status code.
2025-11-01 08:41:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-80ga-red-extended-core-bundling-film-ph-361115>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-6-charcoal-waterhog-mat-ph-737192> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-6-charcoal-waterhog-mat-ph-737192 returned 404 status code.
2025-11-01 08:41:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-8-magnetic-c-channel-cardholders-ph-416037>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-1-fluorescent-yellow-rectangle-laser-labels-ph-414515>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-200-2-mil-clear-poly-sheeting-ph-352113>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-75-corrugated-rib-runners-ph-737575> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-75-corrugated-rib-runners-ph-737575 returned 404 status code.
2025-11-01 08:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 14225 pages (at 387 pages/min), scraped 6029 items (at 162 items/min)
2025-11-01 08:41:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:09 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:41:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-8-black-yellow-anti-fatigue-mat-ph-737360> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-8-black-yellow-anti-fatigue-mat-ph-737360 returned 404 status code.
2025-11-01 08:41:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-20-charcoal-waterhog-runner-ph-737294> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-20-charcoal-waterhog-runner-ph-737294 returned 404 status code.
2025-11-01 08:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-2-fluorescent-pastel-blue-rectangle-laser-labels-ph-414549>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-2-fluorescent-pink-rectangle-laser-labels-ph-414553>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:13 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:41:13 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-20-red-black-waterhog-runner-ph-737298> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-20-red-black-waterhog-runner-ph-737298 returned 404 status code.
2025-11-01 08:41:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-2-x-6-2-mil-gusseted-reclosable-poly-bag-ph-318115>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/duct-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-8-x-020-gauge-x-2360-high-tensile-steel-strapping-ph-471073>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-8-x-3000-poly-cord-strapping-ph-475003>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:22 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-shelf-wire-shelving-with-green-bins-ph-715155> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-shelf-wire-shelving-with-green-bins-ph-715155 returned 404 status code.
2025-11-01 08:41:22 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:41:22 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-shelf-wire-shelving-with-blue-bins-ph-715151> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-shelf-wire-shelving-with-blue-bins-ph-715151 returned 404 status code.
2025-11-01 08:41:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-120ga-x-600-bundling-stretch-film-ph-361197>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-12-2-mil-flat-poly-bag-ph-311413>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/wholesale-label-protection-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:24 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-x-11-2-mil-flat-poly-bag-ph-311427> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-x-11-2-mil-flat-poly-bag-ph-311427 returned 404 status code.
2025-11-01 08:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:26 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-x-1-1-4-polyurethane-swivel-casters-ph-715389> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-x-1-1-4-polyurethane-swivel-casters-ph-715389 returned 404 status code.
2025-11-01 08:41:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-5-32-blue-plastic-twist-ties-ph-345299>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-5-x-5-white-corrugated-mailers-ph-211249>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-6-100ga-shrink-bags-ph-381103>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-11-cool-shield-bubble-mailers-ph-185123>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-19-2-mil-flat-poly-bag-ph-311662>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-24-3-mil-flat-poly-bag-ph-311670>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-30-4-mil-flat-poly-bag-ph-311609>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/brute-trash-can-20-gallon-red-ph-743167>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/brute-trash-can-32-gallon-green-ph-743191>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/cable-tie-kit-assorted-colors-ph-446009>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-flat-trash-can-lid-55-gal-green-ph-743279> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-flat-trash-can-lid-55-gal-green-ph-743279 returned 404 status code.
2025-11-01 08:41:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-recycling-container-32-gal-green-ph-742125> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-recycling-container-32-gal-green-ph-742125 returned 404 status code.
2025-11-01 08:41:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-trash-can-20-gallon-white-ph-743169> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-trash-can-20-gallon-white-ph-743169 returned 404 status code.
2025-11-01 08:41:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-trash-can-10-gallon-gray-ph-743137> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-trash-can-10-gallon-gray-ph-743137 returned 404 status code.
2025-11-01 08:41:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-trash-can-32-gallon-blue-ph-743189> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-trash-can-32-gallon-blue-ph-743189 returned 404 status code.
2025-11-01 08:41:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-trash-can-32-gallon-white-ph-743197> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-trash-can-32-gallon-white-ph-743197 returned 404 status code.
2025-11-01 08:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:45 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/clear-poly-gloves-1-mil-ph-891125> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/clear-poly-gloves-1-mil-ph-891125 returned 404 status code.
2025-11-01 08:41:45 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/charmin-2-ply-bathroom-tissue-ph-821009> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/charmin-2-ply-bathroom-tissue-ph-821009 returned 404 status code.
2025-11-01 08:41:45 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-trash-can-55-gallon-yellow-ph-743269> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-trash-can-55-gallon-yellow-ph-743269 returned 404 status code.
2025-11-01 08:41:45 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-trash-can-44-gallon-blue-ph-743225> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-trash-can-44-gallon-blue-ph-743225 returned 404 status code.
2025-11-01 08:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/deluxe-cowhide-leather-driver-glove-xl-ph-891275> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/deluxe-cowhide-leather-driver-glove-xl-ph-891275 returned 404 status code.
2025-11-01 08:41:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/deerskin-leather-drivers-gloves-xlarge-ph-891299> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/deerskin-leather-drivers-gloves-xlarge-ph-891299 returned 404 status code.
2025-11-01 08:41:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/door-sign-no-smoking-ph-781181> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/door-sign-no-smoking-ph-781181 returned 404 status code.
2025-11-01 08:41:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/cowhide-leather-drivers-gloves-large-ph-891261> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/cowhide-leather-drivers-gloves-large-ph-891261 returned 404 status code.
2025-11-01 08:41:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/door-sign-entrance-ph-781177> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/door-sign-entrance-ph-781177 returned 404 status code.
2025-11-01 08:41:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/e-a-r-classic-earplugs-in-pillow-pak-ph-725109> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/e-a-r-classic-earplugs-in-pillow-pak-ph-725109 returned 404 status code.
2025-11-01 08:41:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/emergency-exit-only-6-x-9-facility-sign-ph-781125> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/emergency-exit-only-6-x-9-facility-sign-ph-781125 returned 404 status code.
2025-11-01 08:41:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/employees-must-wash-hands-6-x-9-facility-sign-ph-781143> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/employees-must-wash-hands-6-x-9-facility-sign-ph-781143 returned 404 status code.
2025-11-01 08:41:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/e-a-rsoft-yellow-neons-earplugs-refill-ph-725115> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/e-a-rsoft-yellow-neons-earplugs-refill-ph-725115 returned 404 status code.
2025-11-01 08:41:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/door-sign-elevator-ph-781197> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/door-sign-elevator-ph-781197 returned 404 status code.
2025-11-01 08:41:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/e-a-r-classic-earplugs-refill-ph-725113> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/e-a-r-classic-earplugs-refill-ph-725113 returned 404 status code.
2025-11-01 08:41:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:49 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-12-hog-heaven-nitrile-mats-ph-737570> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-12-hog-heaven-nitrile-mats-ph-737570 returned 404 status code.
2025-11-01 08:41:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:49 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-12-charcoal-vinyl-carpet-mat-ph-737535> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-12-charcoal-vinyl-carpet-mat-ph-737535 returned 404 status code.
2025-11-01 08:41:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-15-black-economy-anti-fatigue-mat-ph-737371> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-15-black-economy-anti-fatigue-mat-ph-737371 returned 404 status code.
2025-11-01 08:41:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-16-medium-gray-waterhog-mat-ph-737218> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-16-medium-gray-waterhog-mat-ph-737218 returned 404 status code.
2025-11-01 08:41:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:52 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-12-red-black-waterhog-mat-ph-737214> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-12-red-black-waterhog-mat-ph-737214 returned 404 status code.
2025-11-01 08:41:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:54 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-16-premium-anti-fatigue-mat-ph-737435> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-16-premium-anti-fatigue-mat-ph-737435 returned 404 status code.
2025-11-01 08:41:54 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-20-charcoal-waterhog-runner-ph-737306> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-20-charcoal-waterhog-runner-ph-737306 returned 404 status code.
2025-11-01 08:41:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:54 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-20-medium-gray-waterhog-runner-ph-737308> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-20-medium-gray-waterhog-runner-ph-737308 returned 404 status code.
2025-11-01 08:41:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/carton-sealing-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/402-x-1345-black-sato-thermal-transfer-ribbons-wax-ph-415153>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:41:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:55 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-20-navy-waterhog-runner-ph-737309> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-20-navy-waterhog-runner-ph-737309 returned 404 status code.
2025-11-01 08:41:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:55 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-9-black-yellow-anti-fatigue-mat-ph-737363> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-9-black-yellow-anti-fatigue-mat-ph-737363 returned 404 status code.
2025-11-01 08:41:55 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-20-red-black-waterhog-runner-ph-737310> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-20-red-black-waterhog-runner-ph-737310 returned 404 status code.
2025-11-01 08:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:57 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:41:57 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:58 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:41:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:00 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/40-x-46-black-can-liners-ph-751175> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/40-x-46-black-can-liners-ph-751175 returned 404 status code.
2025-11-01 08:42:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-3-1-3-white-rectangle-laser-labels-master-case-ph-414599>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-36-yds-black-solid-vinyl-safety-tape-ph-631383>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:00 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/40-x-46-clear-can-liners-ph-751127> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/40-x-46-clear-can-liners-ph-751127 returned 404 status code.
2025-11-01 08:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-42-kraft-heavy-duty-tubes-with-caps-ph-213623>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:42:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:42:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:42:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:08 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:42:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 14616 pages (at 391 pages/min), scraped 6185 items (at 156 items/min)
2025-11-01 08:42:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:42:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:42:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:19 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-6-charcoal-waterhog-mat-ph-737264> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-6-charcoal-waterhog-mat-ph-737264 returned 404 status code.
2025-11-01 08:42:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-36-4-mil-reclosable-poly-bag-ph-315374>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:42:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:24 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-75ga-x-3500-poly-olefin-shrink-film-ph-384105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-75ga-x-3500-poly-olefin-shrink-film-ph-384105 returned 404 status code.
2025-11-01 08:42:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:32 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/8-x-4-x-15-2-mil-gusseted-reclosable-poly-bag-ph-318325> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/8-x-4-x-15-2-mil-gusseted-reclosable-poly-bag-ph-318325 returned 404 status code.
2025-11-01 08:42:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:42:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/hand-saver-dispenser-ph-341111>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:42:33 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/esd-uncoated-nylon-gloves-large-ph-891073> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/esd-uncoated-nylon-gloves-large-ph-891073 returned 404 status code.
2025-11-01 08:42:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/hc-900-economy-steel-box-cutter-ph-732143>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:42:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:33 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/esd-palm-coated-nylon-gloves-small-ph-891081> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/esd-palm-coated-nylon-gloves-small-ph-891081 returned 404 status code.
2025-11-01 08:42:33 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/fire-extinguisher-9-x-6-facility-sign-ph-781151> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/fire-extinguisher-9-x-6-facility-sign-ph-781151 returned 404 status code.
2025-11-01 08:42:34 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/esd-uncoated-nylon-gloves-extra-large-ph-891075> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/esd-uncoated-nylon-gloves-extra-large-ph-891075 returned 404 status code.
2025-11-01 08:42:34 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/fingerless-pvc-dot-knit-gloves-small-ph-891415> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/fingerless-pvc-dot-knit-gloves-small-ph-891415 returned 404 status code.
2025-11-01 08:42:34 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/exam-grade-latex-gloves-powder-free-l-ph-891143> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/exam-grade-latex-gloves-powder-free-l-ph-891143 returned 404 status code.
2025-11-01 08:42:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/infectious-waste-trash-bag-40-45-gal-ph-758109>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:42:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:34 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/gojo-fast-wipes-(1-pack)-ph-846003> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/gojo-fast-wipes-(1-pack)-ph-846003 returned 404 status code.
2025-11-01 08:42:34 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/fluorescent-yellow-sharpie-highlighters-ph-734169> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/fluorescent-yellow-sharpie-highlighters-ph-734169 returned 404 status code.
2025-11-01 08:42:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/kimwipes-2-ply-147-x-166-low-lint-wipers-ph-844023>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:42:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/gojo-cherry-gel-pumice-hand-cleaner-ph-822021> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/gojo-cherry-gel-pumice-hand-cleaner-ph-822021 returned 404 status code.
2025-11-01 08:42:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/gritless-sweeping-compound-100-lb-bag-ph-842005> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/gritless-sweeping-compound-100-lb-bag-ph-842005 returned 404 status code.
2025-11-01 08:42:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/glutton-recycling-container-lid-56-gal-ph-742151> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/glutton-recycling-container-lid-56-gal-ph-742151 returned 404 status code.
2025-11-01 08:42:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-black-33-gallon-63-mil-ph-754141> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-black-33-gallon-63-mil-ph-754141 returned 404 status code.
2025-11-01 08:42:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/glad-drawstring-trash-bag-30-gal-black-ph-753103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/glad-drawstring-trash-bag-30-gal-black-ph-753103 returned 404 status code.
2025-11-01 08:42:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-black-56-gallon-86-mil-ph-754155> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-black-56-gallon-86-mil-ph-754155 returned 404 status code.
2025-11-01 08:42:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-black-6-bushel-67-mil-ph-754157> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-black-6-bushel-67-mil-ph-754157 returned 404 status code.
2025-11-01 08:42:36 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/heavy-duty-original-keybak-key-holder-ph-739107> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/heavy-duty-original-keybak-key-holder-ph-739107 returned 404 status code.
2025-11-01 08:42:36 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-black-33-gallon-86-mil-ph-754143> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-black-33-gallon-86-mil-ph-754143 returned 404 status code.
2025-11-01 08:42:36 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hands-free-trash-can-23-gallon-beige-ph-746109> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hands-free-trash-can-23-gallon-beige-ph-746109 returned 404 status code.
2025-11-01 08:42:36 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/kleenex-cottonelle-2-ply-bathroom-tissue-ph-821007> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/kleenex-cottonelle-2-ply-bathroom-tissue-ph-821007 returned 404 status code.
2025-11-01 08:42:36 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/gojo-multi-green-hand-cleaner-refill-ph-822029> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/gojo-multi-green-hand-cleaner-refill-ph-822029 returned 404 status code.
2025-11-01 08:42:36 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/knifehandler-gloves-medium-ph-891063> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/knifehandler-gloves-medium-ph-891063 returned 404 status code.
2025-11-01 08:42:36 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/kimtech-wipers-pop-up-box-ph-844041> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/kimtech-wipers-pop-up-box-ph-844041 returned 404 status code.
2025-11-01 08:42:36 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/knifehandler-gloves-large-ph-891065> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/knifehandler-gloves-large-ph-891065 returned 404 status code.
2025-11-01 08:42:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-13-sm-pk-2-mil-reclosable-poly-bag-ph-311743>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:42:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:37 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/infectious-waste-trash-liner-30-gallon-ph-758101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/infectious-waste-trash-liner-30-gallon-ph-758101 returned 404 status code.
2025-11-01 08:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:40 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-natural-33-gallon-67-mil-ph-754117> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-natural-33-gallon-67-mil-ph-754117 returned 404 status code.
2025-11-01 08:42:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/green-marsh-88fx-metal-paint-markers-ph-734111> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/green-marsh-88fx-metal-paint-markers-ph-734111 returned 404 status code.
2025-11-01 08:42:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:42:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-10-x-5-korrvu-retention-packaging-ph-121109>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:42:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/13-x-11-x-7-corrugated-boxes-ph-101387>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:59 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/13-7-8-x-6-3-4-stack-hang-dividers-ph-712117> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/13-7-8-x-6-3-4-stack-hang-dividers-ph-712117 returned 404 status code.
2025-11-01 08:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:02 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:43:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-18-open-end-static-shielding-bags-ph-334365>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-20-6-mil-flat-poly-bag-ph-312108>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 14993 pages (at 377 pages/min), scraped 6350 items (at 165 items/min)
2025-11-01 08:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/17-1-2-x-12-x-3-flat-corrugated-boxes-ph-101815>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-5-yds-white-3m-4932-vhb-tape-ph-696163>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:16 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-15-x-10-economy-file-storage-boxes-ph-718115>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:22 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:43:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:25 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:25 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:26 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:43:26 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:43:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:27 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:43:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:28 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:43:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:29 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:43:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-2-fluorescent-pastel-blue-rectangle-laser-labels-ph-414359>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:31 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:43:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:32 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-16-black-economy-anti-fatigue-mat-ph-737341> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-16-black-economy-anti-fatigue-mat-ph-737341 returned 404 status code.
2025-11-01 08:43:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-2-x-18-160-edge-protectors-skid-lot-ph-462009>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:40 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/duct-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/30-x-48-2-mil-flat-poly-bag-ph-312400>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/30-x-60-2-mil-flat-poly-bag-ph-312401>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:42 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/30-x-36-black-can-liners-ph-751149> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/30-x-36-black-can-liners-ph-751149 returned 404 status code.
2025-11-01 08:43:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-3-1-2-x-2-folding-cartons-ph-981127>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:43:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:43:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-12-x-2-anti-static-convoluted-foam-ph-547103>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:01 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 15362 pages (at 369 pages/min), scraped 6508 items (at 158 items/min)
2025-11-01 08:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-blue-stack-hang-bin-ph-711213>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:13 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-yellow-stack-hang-bin-ph-711211> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-yellow-stack-hang-bin-ph-711211 returned 404 status code.
2025-11-01 08:44:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-clear-stack-hang-bin-ph-711215> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-clear-stack-hang-bin-ph-711215 returned 404 status code.
2025-11-01 08:44:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-green-stack-hang-bin-ph-711217> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-green-stack-hang-bin-ph-711217 returned 404 status code.
2025-11-01 08:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:19 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-7-8-x-11-1-8-x-4-red-shelf-bins-ph-711377> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-7-8-x-11-1-8-x-4-red-shelf-bins-ph-711377 returned 404 status code.
2025-11-01 08:44:19 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-7-8-x-11-1-8-x-4-yellow-shelf-bins-ph-711379> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-7-8-x-11-1-8-x-4-yellow-shelf-bins-ph-711379 returned 404 status code.
2025-11-01 08:44:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:20 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-7-8-x-6-5-8-x-4-blue-shelf-bins-ph-711353> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-7-8-x-6-5-8-x-4-blue-shelf-bins-ph-711353 returned 404 status code.
2025-11-01 08:44:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/17-x-14-x-14-corrugated-boxes-ph-101833>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:21 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-7-8-x-8-3-8-x-4-blue-shelf-bins-ph-711363> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-7-8-x-8-3-8-x-4-blue-shelf-bins-ph-711363 returned 404 status code.
2025-11-01 08:44:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/17-x-19-moisture-barrier-bags-ph-333145>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:22 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-x-14-1-2-gray-stack-nest-lids-ph-717149> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-x-14-1-2-gray-stack-nest-lids-ph-717149 returned 404 status code.
2025-11-01 08:44:23 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-x-14-1-2-x-12-7-8-gray-stack-nest-bin-ph-717125> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-x-14-1-2-x-12-7-8-gray-stack-nest-bin-ph-717125 returned 404 status code.
2025-11-01 08:44:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:23 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-x-10-1-4-stack-hang-bin-dividers-ph-712123> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-x-10-1-4-stack-hang-bin-dividers-ph-712123 returned 404 status code.
2025-11-01 08:44:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-60-yds-orange-masking-tape-ph-681377>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:25 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-7-8-x-4-1-8-x-4-red-shelf-bins-ph-711349> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-7-8-x-4-1-8-x-4-red-shelf-bins-ph-711349 returned 404 status code.
2025-11-01 08:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-electrical-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:28 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-7-8-x-11-1-8-x-4-green-shelf-bins-ph-711375> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-7-8-x-11-1-8-x-4-green-shelf-bins-ph-711375 returned 404 status code.
2025-11-01 08:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-double-sided-film-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2.52-x-1181-black-datamax-thermal-transfer-ribbons-wax-ph-415119> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2.52-x-1181-black-datamax-thermal-transfer-ribbons-wax-ph-415119 returned 404 status code.
2025-11-01 08:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-20-x-14-corrugated-boxes-ph-102409>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-20-x-6-kraft-jumbo-mailers-ph-211843>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:31 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:44:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:32 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:44:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-24-8-mil-reclosable-poly-bag-ph-315611>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:32 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:44:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:32 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:44:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:33 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:44:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:34 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:35 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:36 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/specialty-tapes> (failed 3 times): Invalid response, retrying...
2025-11-01 08:44:36 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/specialty-tapes> (failed 3 times): Invalid response, retrying...
2025-11-01 08:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:36 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:37 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:44:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-2-x-36-160-edge-protectors-skid-lot-ph-462029>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:38 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:44:38 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:44:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-2-x-7-kraft-reverse-tuck-folding-cartons-ph-971197>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-1-2-l-vinyl-warehouse-letter-labels-ph-417049>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-3-6-mil-anti-static-flat-poly-bag-ph-331293> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-3-6-mil-anti-static-flat-poly-bag-ph-331293 returned 404 status code.
2025-11-01 08:44:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-1-4-x-1-5-8-fluor-orange-13-pt-shipping-tag-wired-ph-423093>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-1-4-x-1-5-8-fluor-red-13-pt-shipping-tags-pre-wired-ph-423105>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-1-4-x-1-5-8-yellow-tyvek-pre-wired-shipping-tag-ph-424045>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-2-white-rectangle-laser-labels-ph-414411>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-36-white-tubes-with-caps-ph-213533>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:59 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-30-3-mil-flat-poly-bag-ph-311194> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-30-3-mil-flat-poly-bag-ph-311194 returned 404 status code.
2025-11-01 08:44:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:44:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-1-2-x-6-green-packing-list-enclosed-envelopes-ph-451013>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-1-4-x-2-1-8-fluorescent-pink-13-pt-shipping-tags-ph-423257>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-fragile-do-not-stack-labels-ph-411905>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 15750 pages (at 388 pages/min), scraped 6664 items (at 156 items/min)
2025-11-01 08:45:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-rush-medical-supplies-fluorescent-red-labels-ph-411211>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-4-navy-waterhog-mat-ph-737225> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-4-navy-waterhog-mat-ph-737225 returned 404 status code.
2025-11-01 08:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-x-6-kraft-reverse-tuck-folding-cartons-ph-971309>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-4-non-flammable-gas-labels-ph-413073> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-4-non-flammable-gas-labels-ph-413073 returned 404 status code.
2025-11-01 08:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:16 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-4-red-black-waterhog-mat-ph-737226> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-4-red-black-waterhog-mat-ph-737226 returned 404 status code.
2025-11-01 08:45:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-6-2-mil-flat-poly-bag-ph-311356>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-6-3-mil-flat-poly-bag-ph-311363>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:22 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-x-7-2-milhangholereclosable-poly-bag-ph-315054> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-x-7-2-milhangholereclosable-poly-bag-ph-315054 returned 404 status code.
2025-11-01 08:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-8-2-mil-white-block-reclosable-poly-bag-ph-317183>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-8-4-mil-poly-bag-on-a-roll-ph-314283>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-8-4-mil-minigrip-anti-static-reclosable-poly-bag-ph-313217> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-8-4-mil-minigrip-anti-static-reclosable-poly-bag-ph-313217 returned 404 status code.
2025-11-01 08:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-7-x-7-corrugated-boxes-ph-103195>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:38 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-9-red-job-ticket-holders-ph-731119> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-9-red-job-ticket-holders-ph-731119 returned 404 status code.
2025-11-01 08:45:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-8-open-end-static-shielding-bags-ph-334237>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-8-x-8-insulated-box-liners-ph-186139>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/kraft-1-self-seal-bubble-mailers-ph-241163>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/kraft-2-heat-seal-bubble-mailers-ph-241177>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:52 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 08:45:52 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/latex-industrial-gloves-powder-free-m-ph-891159> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/latex-industrial-gloves-powder-free-m-ph-891159 returned 404 status code.
2025-11-01 08:45:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-5-x-2-white-corrugated-mailers-ph-211523>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-6-x-4-corrugated-boxes-ph-101059>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:54 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/liners-for-sanitary-napkin-receptacles-ph-825005> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/liners-for-sanitary-napkin-receptacles-ph-825005 returned 404 status code.
2025-11-01 08:45:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-7-x-3-kraft-corrugated-mailers-ph-211547>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:55 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/latex-industrial-gloves-powder-free-l-ph-891161> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/latex-industrial-gloves-powder-free-l-ph-891161 returned 404 status code.
2025-11-01 08:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:55 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/marshal-domed-trash-can-25-gallon-black-ph-745105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/marshal-domed-trash-can-25-gallon-black-ph-745105 returned 404 status code.
2025-11-01 08:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-1-4-x-3-x-15-1-8-fol-self-seal-white-ph-114125>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:45:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-12-x-72-tall-corrugated-boxes-ph-101273>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-12-x-8-corrugated-boxes-ph-101275>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:45:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-15-3-mil-flat-poly-bag-ph-312117>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-15-light-amber-glue-sticks-ph-676009>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 16119 pages (at 369 pages/min), scraped 6833 items (at 169 items/min)
2025-11-01 08:46:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-15-resealable-suffocation-warning-poly-bag-ph-335171>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-1-2-x-12-1-2-x-7-corrugated-boxes-ph-101903>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-8-320-lb-white-solid-braided-nylon-rope-ph-476111>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:25 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-11-x-10-clear-stack-hang-bins-ph-711271> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-11-x-10-clear-stack-hang-bins-ph-711271 returned 404 status code.
2025-11-01 08:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-8-x-12-x-350-parcel-ready-perfed-foam-ph-541209 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:28 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-11-x-10-red-stack-hang-bins-ph-711277> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-11-x-10-red-stack-hang-bins-ph-711277 returned 404 status code.
2025-11-01 08:46:28 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/20-7-8-x-18-1-4-x-9-7-8-red-stack-nest-bin-ph-717129> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/20-7-8-x-18-1-4-x-9-7-8-red-stack-nest-bin-ph-717129 returned 404 status code.
2025-11-01 08:46:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:29 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/20-7-8-x-18-1-4-x-9-7-8-gray-stack-nest-bin-ph-717131> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/20-7-8-x-18-1-4-x-9-7-8-gray-stack-nest-bin-ph-717131 returned 404 status code.
2025-11-01 08:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-14-x-3-flat-corrugated-boxes-ph-102069>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-14-x-6-flat-corrugated-boxes-ph-102073>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-16-x-16-corrugated-boxes-ph-102093>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-30-4-mil-anti-static-flat-poly-bag-ph-331279>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:40 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/24-x-31-clear-can-liners-ph-751107> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/24-x-31-clear-can-liners-ph-751107 returned 404 status code.
2025-11-01 08:46:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-36-yds-black-yellow-3m-766-striped-vinyl-tape-ph-631421>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-counted-___-fluorescent-yellow-labels-ph-412269>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/32-x-16-x-16-long-corrugated-boxes-ph-102791>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-3-4-x-1-7-8-10-pt-manila-shipping-tags-pre-wired-ph-422027>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:46:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-3-4-x-1-7-8-green-13-pt-shipping-tags-ph-423197>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-25-kraft-square-mailing-tubes-ph-213479>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-3-white-reverse-tuck-folding-cartons-ph-971251>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 16463 pages (at 344 pages/min), scraped 6996 items (at 163 items/min)
2025-11-01 08:47:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:09 [py.warnings] (PID: 95) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2025-11-01 08:47:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-1-4-x-2-1-8-red-tyvek-shipping-tag-ph-424089>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:10 [scrapy.extensions.feedexport] (PID: 95) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:7
2025-11-01 08:47:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-1-4-x-5-1-2-white-rectangle-laser-labels-master-case-ph-414485>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/433-x-1181-black-datamax-thermal-transfer-ribbons-wax-ph-415159>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-3-mil-flat-poly-bag-ph-311259>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-8-2-mil-poly-bag-on-a-roll-ph-314235>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/60-x-36-x-86-4-shelf-wire-shelving-ph-715273>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:31 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/60-x-18-x-54-4-shelf-wire-shelving-ph-715229> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/60-x-18-x-54-4-shelf-wire-shelving-ph-715229 returned 404 status code.
2025-11-01 08:47:31 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/60-x-18-x-63-4-shelf-wire-shelving-ph-715233> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/60-x-18-x-63-4-shelf-wire-shelving-ph-715233 returned 404 status code.
2025-11-01 08:47:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:32 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/60-x-36-x-74-4-shelf-wire-shelving-ph-715269> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/60-x-36-x-74-4-shelf-wire-shelving-ph-715269 returned 404 status code.
2025-11-01 08:47:32 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/60-x-18-x-63-wire-shelving-add-on-unit-ph-715235> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/60-x-18-x-63-wire-shelving-add-on-unit-ph-715235 returned 404 status code.
2025-11-01 08:47:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-1-2-x-3-1-4-x-1-3-4-white-corrugated-mailer-ph-211359>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:32 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/60-x-36-x-54-wire-shelving-add-on-unit-ph-715263> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/60-x-36-x-54-wire-shelving-add-on-unit-ph-715263 returned 404 status code.
2025-11-01 08:47:32 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/safety-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:47:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-1-4-x-2-x-7-1-4-white-reverse-tuck-folding-cartons-ph-971351>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/72--40-lb-kraft-paper-rolls-ph-511211>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:39 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/72-x-24-wire-shelf-2-pack-ph-715365> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/72-x-24-wire-shelf-2-pack-ph-715365 returned 404 status code.
2025-11-01 08:47:39 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/72-x-24-x-63-4-shelf-wire-shelving-ph-715297> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/72-x-24-x-63-4-shelf-wire-shelving-ph-715297 returned 404 status code.
2025-11-01 08:47:40 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/72-x-24-x-86-wire-shelving-add-on-unit-ph-715307> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/72-x-24-x-86-wire-shelving-add-on-unit-ph-715307 returned 404 status code.
2025-11-01 08:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:40 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/72-x-36-wire-shelves-2-pack-ph-715371> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/72-x-36-wire-shelves-2-pack-ph-715371 returned 404 status code.
2025-11-01 08:47:41 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/72-x-18-x-74-4-shelf-wire-shelving-ph-715285> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/72-x-18-x-74-4-shelf-wire-shelving-ph-715285 returned 404 status code.
2025-11-01 08:47:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:42 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-7-8-x-6-3-4-stack-hang-bin-dividers-ph-712107> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-7-8-x-6-3-4-stack-hang-bin-dividers-ph-712107 returned 404 status code.
2025-11-01 08:47:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/product-cushioning>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/nitrile-gloves-4-mil-large-ph-891185> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/nitrile-gloves-4-mil-large-ph-891185 returned 404 status code.
2025-11-01 08:47:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/nitrile-gloves-6-mil-large-ph-891193> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/nitrile-gloves-6-mil-large-ph-891193 returned 404 status code.
2025-11-01 08:47:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/postal-approved-poly-strapping-kit-ph-472021>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/nitrile-gloves-6-mil-xlarge-ph-891195> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/nitrile-gloves-6-mil-xlarge-ph-891195 returned 404 status code.
2025-11-01 08:47:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/product-cushioning>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/replacement-tape-cutting-blades-for-3-8-bag-taper-ph-343111>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/nitrile-gloves-exam-grade-medium-ph-891175> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/nitrile-gloves-exam-grade-medium-ph-891175 returned 404 status code.
2025-11-01 08:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/nitrile-gloves-4-mil-medium-ph-891183> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/nitrile-gloves-4-mil-medium-ph-891183 returned 404 status code.
2025-11-01 08:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/oil-dry-ph-843007> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/oil-dry-ph-843007 returned 404 status code.
2025-11-01 08:47:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/office-recycling-container-10-gal-blue-ph-742135> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/office-recycling-container-10-gal-blue-ph-742135 returned 404 status code.
2025-11-01 08:47:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/paper-plates-9-ph-882100> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/paper-plates-9-ph-882100 returned 404 status code.
2025-11-01 08:47:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:49 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/plastic-knives-ph-882001> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/plastic-knives-ph-882001 returned 404 status code.
2025-11-01 08:47:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:49 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/rb-009-single-edge-blades-ph-732193> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/rb-009-single-edge-blades-ph-732193 returned 404 status code.
2025-11-01 08:47:49 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/please-clean-microwave-6-x-9-facility-sign-ph-781129> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/please-clean-microwave-6-x-9-facility-sign-ph-781129 returned 404 status code.
2025-11-01 08:47:49 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/pro-fingerless-glove-l-ph-891113> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/pro-fingerless-glove-l-ph-891113 returned 404 status code.
2025-11-01 08:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/red-spring-back-pocket-safety-cutter-ph-732183> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/red-spring-back-pocket-safety-cutter-ph-732183 returned 404 status code.
2025-11-01 08:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/rubber-coated-palm-gloves-extra-large-ph-891433> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/rubber-coated-palm-gloves-extra-large-ph-891433 returned 404 status code.
2025-11-01 08:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/rsg-194-safety-grip-utility-knife-yellow-ph-732109> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/rsg-194-safety-grip-utility-knife-yellow-ph-732109 returned 404 status code.
2025-11-01 08:47:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/red-marsh-88-valve-markers-ph-734105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/red-marsh-88-valve-markers-ph-734105 returned 404 status code.
2025-11-01 08:47:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1-2-dark-blue-inventory-circle-labels-ph-412219>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/premium-safety-cutter-ambidextrous-ph-732167> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/premium-safety-cutter-ambidextrous-ph-732167 returned 404 status code.
2025-11-01 08:47:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1-2-fluorescent-pink-inventory-circle-labels-ph-412231>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:53 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/s5fc-s5-film-cutter-replacement-blades-ph-732209> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/s5fc-s5-film-cutter-replacement-blades-ph-732209 returned 404 status code.
2025-11-01 08:47:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1-2-x-1-1-2-x-2-1-4-white-reverse-tuck-cartons-ph-971103>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 08:47:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 08:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-16-8-mil-flat-poly-bag-ph-312131>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-16-x-2-expandable-ship-lite-envelopes-ph-262115>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:47:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-18-x-10-jumbo-bin-boxes-ph-171155>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:47:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 16846 pages (at 383 pages/min), scraped 7161 items (at 165 items/min)
2025-11-01 08:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-13-x-5-flat-corrugated-boxes-ph-101919>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-18-6-mil-reclosable-poly-bag-ph-315602>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-18--butcher-paper-sheets-ph-512181>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:22 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-16-1-2-x-11-black-conductive-bins-ph-711425> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-16-1-2-x-11-black-conductive-bins-ph-711425 returned 404 status code.
2025-11-01 08:48:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-18-x-12-heavy-duty-boxes-ph-115261>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:22 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-16-1-2-x-11-green-stack-hang-bin-ph-711287> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-16-1-2-x-11-green-stack-hang-bin-ph-711287 returned 404 status code.
2025-11-01 08:48:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:24 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-16-1-2-x-11-yellow-stack-hang-bin-ph-711295> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-16-1-2-x-11-yellow-stack-hang-bin-ph-711295 returned 404 status code.
2025-11-01 08:48:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-20-x-12-multi-depth-corrugated-box-ph-113259>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-20-x-4-kraft-deluxe-literature-mailer-ph-212327>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-24-reclosable-static-shielding-bags-ph-334395>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-30-heavy-tissue-paper-ph-941149>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-900-parcel-ready-perforated-foam-roll-ph-541157 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:37 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/25-3-4-x-16-x-12-1-2-round-trip-tote-ph-717105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/25-3-4-x-16-x-12-1-2-round-trip-tote-ph-717105 returned 404 status code.
2025-11-01 08:48:37 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 08:48:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-handle-with-care-liquid-thank-you-labels-ph-411829>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-4-this-side-up-arrow-labels-ph-411679>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-3-4-x-1-7-8-red-tyvek-shipping-tag-ph-424065>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/33-x-39-clear-can-liners-ph-751113> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/33-x-39-clear-can-liners-ph-751113 returned 404 status code.
2025-11-01 08:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:49 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/33-x-40-black-can-liners-ph-751153> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/33-x-40-black-can-liners-ph-751153 returned 404 status code.
2025-11-01 08:48:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-double-notch-steel-strapping-sealer-ph-471035>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/33-x-40-black-can-liners-ph-751163> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/33-x-40-black-can-liners-ph-751163 returned 404 status code.
2025-11-01 08:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/33-x-40-black-can-liners-ph-751159> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/33-x-40-black-can-liners-ph-751159 returned 404 status code.
2025-11-01 08:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-1000-3m-178-freezer-tape-ph-681239>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/354-x-1476-black-zebra-thermal-transfer-ribbons-wax-ph-415145>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/35-x-35-x-72-4-mil-vci-gusseted-poly-bag-ph-336113>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-1-2-x-36-1-2-x-40-telescoping-boxes-ph-131193>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:48:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-x-100ga-reynolon-5044-pvc-shrink-film-ph-383179>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:01 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:49:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:06 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/specialty-tapes> (failed 3 times): Invalid response, retrying...
2025-11-01 08:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:08 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:49:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:08 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:49:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 17211 pages (at 365 pages/min), scraped 7324 items (at 163 items/min)
2025-11-01 08:49:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-4-mil-poly-bag-on-a-roll-ph-314145>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-4-mil-reclosable-poly-bag-ph-315142>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/duct-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-3-4-x-2-3-8-green-claim-tag-numbered-strung-ph-428001>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:09 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:49:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-3-4-x-2-3-8-orange-tyvek-shipping-tags-pre-wired-ph-424107>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:21 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-6-black-economy-anti-fatigue-mat-ph-737380> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-6-black-economy-anti-fatigue-mat-ph-737380 returned 404 status code.
2025-11-01 08:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:21 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-6-brown-waterhog-mat-ph-737233> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-6-brown-waterhog-mat-ph-737233 returned 404 status code.
2025-11-01 08:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:22 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-6-brown-superior-vinyl-carpet-mat-ph-737496> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-6-brown-superior-vinyl-carpet-mat-ph-737496 returned 404 status code.
2025-11-01 08:49:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:22 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-6-black-yellow-anti-fatigue-mat-ph-737381> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-6-black-yellow-anti-fatigue-mat-ph-737381 returned 404 status code.
2025-11-01 08:49:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-super-scan-press-on-vinyl-envelopes-ph-416269>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:23 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-5-8-x-2-13-16-stack-hang-dividers-ph-712101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-5-8-x-2-13-16-stack-hang-dividers-ph-712101 returned 404 status code.
2025-11-01 08:49:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:26 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-6-gray-economy-anti-fatigue-mat-ph-737382> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-6-gray-economy-anti-fatigue-mat-ph-737382 returned 404 status code.
2025-11-01 08:49:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-1-4-x-3-1-8-0500-0999-tag-carbonless-stub-style-ph-425081>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:36 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-yellow-stack-hang-bin-ph-711127> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-yellow-stack-hang-bin-ph-711127 returned 404 status code.
2025-11-01 08:49:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-x-12-magnetic-job-ticket-holders-ph-731153> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-x-12-magnetic-job-ticket-holders-ph-731153 returned 404 status code.
2025-11-01 08:49:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-12-white-flat-tyvek-envelopes-ph-261121>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-x-12-neon-orange-job-ticket-holders-ph-731125> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-x-12-neon-orange-job-ticket-holders-ph-731125 returned 404 status code.
2025-11-01 08:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-x-12-neon-green-job-ticket-holders-ph-731123> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-x-12-neon-green-job-ticket-holders-ph-731123 returned 404 status code.
2025-11-01 08:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:49 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-x-12-zippered-job-ticket-holders-ph-731161> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-x-12-zippered-job-ticket-holders-ph-731161 returned 404 status code.
2025-11-01 08:49:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/safety-cutter-utility-knife-left-handed-ph-732125> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/safety-cutter-utility-knife-left-handed-ph-732125 returned 404 status code.
2025-11-01 08:49:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/safegrip-glove-w-extended-beaded-cuff-xl-ph-891343> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/safegrip-glove-w-extended-beaded-cuff-xl-ph-891343 returned 404 status code.
2025-11-01 08:49:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-x-12-job-ticket-holders-with-strap-ph-731145> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-x-12-job-ticket-holders-with-strap-ph-731145 returned 404 status code.
2025-11-01 08:49:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/scott-blue-shop-towels-on-a-roll-ph-845009> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/scott-blue-shop-towels-on-a-roll-ph-845009 returned 404 status code.
2025-11-01 08:49:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/scott-heavy-duty-shop-towels-on-a-roll-ph-845011> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/scott-heavy-duty-shop-towels-on-a-roll-ph-845011 returned 404 status code.
2025-11-01 08:49:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/scott-blue-shop-towels-pop-up-box-ph-845005> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/scott-blue-shop-towels-pop-up-box-ph-845005 returned 404 status code.
2025-11-01 08:49:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/scott-rags-in-a-box-(2-pack)-ph-845003> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/scott-rags-in-a-box-(2-pack)-ph-845003 returned 404 status code.
2025-11-01 08:49:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/sb-92-standard-utility-blades-ph-732173> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/sb-92-standard-utility-blades-ph-732173 returned 404 status code.
2025-11-01 08:49:52 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/shop-towels-natural-25-lb-box-ph-827033> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/shop-towels-natural-25-lb-box-ph-827033 returned 404 status code.
2025-11-01 08:49:52 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/shop-towels-natural-5-lb-box-ph-827031> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/shop-towels-natural-5-lb-box-ph-827031 returned 404 status code.
2025-11-01 08:49:52 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/slim-jim-trash-can-23-gallon-black-ph-742167> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/slim-jim-trash-can-23-gallon-black-ph-742167 returned 404 status code.
2025-11-01 08:49:52 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-clear-33-gal-ph-755153> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-clear-33-gal-ph-755153 returned 404 status code.
2025-11-01 08:49:52 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/sn-195-standard-utility-knife-ph-732117> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/sn-195-standard-utility-knife-ph-732117 returned 404 status code.
2025-11-01 08:49:52 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/slim-jim-paper-recycling-lid-23-gal-blue-ph-742109> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/slim-jim-paper-recycling-lid-23-gal-blue-ph-742109 returned 404 status code.
2025-11-01 08:49:52 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/scott-shop-towels-on-a-roll-for-glass-ph-845013> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/scott-shop-towels-on-a-roll-for-glass-ph-845013 returned 404 status code.
2025-11-01 08:49:52 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/square-recycling-bottle-and-can-lid-blue-ph-742137> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/square-recycling-bottle-and-can-lid-blue-ph-742137 returned 404 status code.
2025-11-01 08:49:53 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/square-recycling-container-50-gal-blue-ph-742147> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/square-recycling-container-50-gal-blue-ph-742147 returned 404 status code.
2025-11-01 08:49:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1-2-x-60-yds-3m-8884-stretchable-tape-ph-645009>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1-2-x-60-yds-kraft-5300-flatback-tape-ph-624065>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:53 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/scrubs-in-a-bucket-hand-cleaner-towels-ph-841101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/scrubs-in-a-bucket-hand-cleaner-towels-ph-841101 returned 404 status code.
2025-11-01 08:49:53 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/sn-395-quick-change-knife-ph-732137> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/sn-395-quick-change-knife-ph-732137 returned 404 status code.
2025-11-01 08:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:53 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/spring-back-safety-cutter-right-handed-ph-732107> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/spring-back-safety-cutter-right-handed-ph-732107 returned 404 status code.
2025-11-01 08:49:53 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/slim-jim-trash-can-23-gallon-yellow-ph-742171> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/slim-jim-trash-can-23-gallon-yellow-ph-742171 returned 404 status code.
2025-11-01 08:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:53 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-1-2-x-60-yds-3m-201+-masking-tape-ph-681641> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-1-2-x-60-yds-3m-201+-masking-tape-ph-681641 returned 404 status code.
2025-11-01 08:49:53 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/telephone-ada-compliant-plastic-sign-ph-781115> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/telephone-ada-compliant-plastic-sign-ph-781115 returned 404 status code.
2025-11-01 08:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:54 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/super-48-retractable-key-holder-2-pack-ph-739103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/super-48-retractable-key-holder-2-pack-ph-739103 returned 404 status code.
2025-11-01 08:49:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1-4-light-blue-bolt-seals-ph-492001>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:57 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/sps-92-duratip-safety-utility-blades-ph-732177> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/sps-92-duratip-safety-utility-blades-ph-732177 returned 404 status code.
2025-11-01 08:49:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-3250-16-x-3-core-polyester-strapping-smooth-ph-473005>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:49:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:49:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-36-yds-3m-926-adhesive-transfer-tape-ph-651111>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/12-x-300-parcel-ready-perfed-bubble-rolls-ph-531121 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-36-4-mil-flat-poly-bag-ph-311817>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:04 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:50:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:04 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:50:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-4-x-2-white-corrugated-mailers-ph-211625>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:05 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:50:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-4-x-68-side-loading-boxes-ph-115167>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/vinyl-safety-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-4-x-72-x-250-air-foam-roll-ph-541311>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:07 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:50:07 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:50:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-8-x-6-corrugated-boxes-ph-101557>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 17600 pages (at 389 pages/min), scraped 7482 items (at 158 items/min)
2025-11-01 08:50:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:09 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:50:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-18-x-30-tall-corrugated-boxes-ph-101977>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-24--30-lb-kraft-paper-sheets-ph-511231>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-24-4-mil-reclosable-poly-bag-ph-315590>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:18 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:50:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-24-x-12-jumbo-bin-boxes-ph-171163>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-26-3-mil-flat-poly-bag-ph-311954>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-36-4-mil-flat-poly-bag-ph-312196>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/gift-tissue-paper already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/20-x-30-light-gray-gift-grade-tissue-paper-ph-941163 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/20-x-30-lavender-gift-grade-tissue-paper-ph-941159 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-30-light-blue-gift-grade-tissue-paper-ph-941161>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/20-x-30-kraft-gift-grade-tissue-paper-ph-941157 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/20-x-30-khaki-gift-grade-tissue-paper-ph-941155 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/20-x-30-kelly-green-gift-grade-tissue-paper-ph-941153 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/20-x-30-holiday-green-gift-grade-tissue-paper-ph-941151 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/product-cushioning>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/20-x-30-heavy-tissue-paper-ph-941149 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/20-x-30-french-vanilla-gift-grade-tissue-paper-ph-941147 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/20-x-30-evergreen-gift-grade-tissue-paper-ph-941145 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/20-x-30-economy-tissue-paper-ph-941143 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/20-x-30-dark-pink-gift-grade-tissue-paper-ph-941141 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/20-x-30-citrus-green-gift-grade-tissue-paper-ph-941139 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/20-x-30-cerise-gift-grade-tissue-paper-ph-941137 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/20-x-30-cabernet-gift-grade-tissue-paper-ph-941135 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/20-x-30-buttercup-gift-grade-tissue-paper-ph-941133 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/20-x-30-brown-gift-grade-tissue-paper-ph-941131 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/20-x-30-black-gift-grade-tissue-paper-ph-941129 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/18-x-24-white-gift-grade-tissue-paper-ph-941127 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/18-x-24-economy-tissue-ph-941125 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:31 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 08:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/15-x-20-white-gift-grade-tissue-paper-ph-941123 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/15-x-20-scarlet-gift-grade-tissue-paper-ph-941121 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/15-x-20-purple-gift-grade-tissue-paper-ph-941119 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/15-x-20-kraft-gift-grade-tissue-paper-ph-941115 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/15-x-20-heavy-tissue-paper-ph-941113 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/15-x-20-parade-blue-gift-grade-tissue-paper-ph-941117>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/15-x-20-economy-tissue-paper-ph-941111 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/15-x-20-citrus-green-gift-grade-tissue-paper-ph-941109 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/15-x-20-cerise-gift-grade-tissue-paper-ph-941107 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/12-x-18-white-gift-grade-tissue-paper-ph-941103 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/15-x-20-black-gift-grade-tissue-paper-ph-941105>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-15-white-gift-grade-tissue-paper-ph-941101>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-1-2-fluorescent-red-circle-laser-labels-ph-414255>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/28-x-17-x-58-1-mil-furniture-covers-ph-323101>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-50-yds-green-3m-3903-duct-tape-ph-682057>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/gaffers-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:54 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:56 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/duct-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:50:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-36-yds-3m-9579-double-sided-film-tape-ph-653001>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-60-yds-red-11-mil-gaffers-tape-ph-693095 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-60-yds-red-11-mil-gaffers-tape-ph-693093 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-60-yds-olive-green-gaffers-tape-ph-693091 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-60-yds-olive-green-gaffers-tape-ph-693089 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-60-yds-green-11-mil-gaffers-tape-ph-693087 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-60-yds-green-11-mil-gaffers-tape-ph-693085 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:01 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-60-yds-gray-11-mil-gaffers-tape-ph-693083 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-60-yds-gray-11-mil-gaffers-tape-ph-693081 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-60-yds-burgundy-11-mil-gaffers-tape-ph-693079 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-adhesive-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-60-yds-brown-11-mil-gaffers-tape-ph-693075 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-60-yds-burgundy-gaffers-tape-ph-693077>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-60-yds-brown-11-mil-gaffers-tape-ph-693073 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-60-yds-blue-11-mil-gaffers-tape-ph-693071 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-60-yds-black-11-mil-gaffers-tape-ph-693067 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-60-yds-blue-11-mil-gaffers-tape-ph-693069>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-50-yds-fluorescent-yellow-gaffers-ph-693053 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-60-yds-black-11-mil-gaffers-tape-ph-693065>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-50-yds-fluorescent-yellow-gaffers-ph-693055>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-50-yds-fluorescent-pink-gaffers-ph-693051 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-50-yds-fluorescent-pink-gaffers-ph-693049 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-50-yds-fluorescent-orange-gaffers-ph-693047 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-50-yds-fluorescent-orange-gaffers-ph-693043 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-50-yds-fluorescent-green-gaffers-ph-693039 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/2-x-50-yds-fluorescent-green-gaffers-ph-693035 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-60-yds-yellow-11-mil-gaffers-tape-ph-693031 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-60-yds-yellow-11-mil-gaffers-tape-ph-693027 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-60-yds-white-11-mil-gaffers-tape-ph-693023 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-60-yds-white-11-mil-gaffers-tape-ph-693019 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:06 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-60-yds-red-11-mil-gaffers-tape-ph-693015 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-60-yds-red-11-mil-gaffers-tape-ph-693011 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-x-60-yds-black-11-mil-gaffers-tape-ph-693003 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-60-yds-black-11-mil-gaffers-tape-ph-693007>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 17972 pages (at 372 pages/min), scraped 7638 items (at 156 items/min)
2025-11-01 08:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:11 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:51:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-x-18-x-86-4-shelf-wire-shelving-ph-715157>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-12-x-86-4-shelf-wire-shelving-ph-715125> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-12-x-86-4-shelf-wire-shelving-ph-715125 returned 404 status code.
2025-11-01 08:51:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-x-250--a-flute-kraft-singleface-ph-518127>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:13 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-19-wall-mounted-panel-rack-ph-714105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-19-wall-mounted-panel-rack-ph-714105 returned 404 status code.
2025-11-01 08:51:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-24-wire-shelves-ph-715335> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-24-wire-shelves-ph-715335 returned 404 status code.
2025-11-01 08:51:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-18-wire-shelves-ph-715331> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-18-wire-shelves-ph-715331 returned 404 status code.
2025-11-01 08:51:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-x-36-x-24-corrugated-boxes-ph-102887>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-12-x-86-wire-shelving-add-on-unit-ph-715129> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-12-x-86-wire-shelving-add-on-unit-ph-715129 returned 404 status code.
2025-11-01 08:51:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-55-yds-blue-box-tape-ph-612253>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:16 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-24-x-63-4-shelf-wire-shelving-ph-715169> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-24-x-63-4-shelf-wire-shelving-ph-715169 returned 404 status code.
2025-11-01 08:51:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-burgundy-waterhog-elite-mat-ph-737395>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/47-x-32-new-wood-heat-treated-pallet-ph-484015>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/48-x-125-parcel-ready-perfed-bubble-roll-ph-531247 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-12-x-54-4-shelf-wire-shelving-ph-715181> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-12-x-54-4-shelf-wire-shelving-ph-715181 returned 404 status code.
2025-11-01 08:51:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-12-x-63-4-shelf-wire-shelving-ph-715185> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-12-x-63-4-shelf-wire-shelving-ph-715185 returned 404 status code.
2025-11-01 08:51:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-12-x-74-4-shelf-wire-shelving-ph-715189> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-12-x-74-4-shelf-wire-shelving-ph-715189 returned 404 status code.
2025-11-01 08:51:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-12-x-74-wire-shelving-add-on-unit-ph-715191> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-12-x-74-wire-shelving-add-on-unit-ph-715191 returned 404 status code.
2025-11-01 08:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:31 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:51:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-7-1-2-self-seal-bubble-pouches-ph-532133>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/48-x-300-parcel-ready-perfed-bubble-roll-ph-531157 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:32 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-24-x-86-wire-shelving-add-on-unit-ph-715227> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-24-x-86-wire-shelving-add-on-unit-ph-715227 returned 404 status code.
2025-11-01 08:51:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-75-loop-white-velcro-tape-strips-ph-673173>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:32 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-18-wire-shelf-ph-715341> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-18-wire-shelf-ph-715341 returned 404 status code.
2025-11-01 08:51:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-8-4-mil-poly-bag-on-a-roll-ph-314209>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-8-green-waterhog-mat-ph-737241>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-8-red-black-waterhog-mat-ph-737244>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-1-2-40-cable-ties-natural-ph-441023>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-1-2-40-green-cable-ties-ph-441073>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-1-2-x-10-red-export-documents-enclosed-envelopes-ph-459003>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:39 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-8-medium-gray-waterhog-mat-ph-737242> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-8-medium-gray-waterhog-mat-ph-737242 returned 404 status code.
2025-11-01 08:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-1-4-x-3-1-8-7500-7999-tag-2-part-carbonless-pre-wired-ph-425285>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-x-4-x-3-white-corrugated-mailers-ph-211319>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-x-4-x-4-kraft-corrugated-mailers-ph-211321>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/vinyl-gloves-3-mil-powdered-l-ph-891351>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:51:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:59 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/7-x-8-4-mil-white-block-reclosable-poly-bag-ph-317165> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/7-x-8-4-mil-white-block-reclosable-poly-bag-ph-317165 returned 404 status code.
2025-11-01 08:51:59 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/twin-bathroom-tissue-dispenser-black-ph-821027> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/twin-bathroom-tissue-dispenser-black-ph-821027 returned 404 status code.
2025-11-01 08:51:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:51:59 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/universal-single-knife-nylon-holster-ph-732169> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/universal-single-knife-nylon-holster-ph-732169 returned 404 status code.
2025-11-01 08:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:00 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/vinyl-glove-3-mil-powdered-m-ph-891349> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/vinyl-glove-3-mil-powdered-m-ph-891349 returned 404 status code.
2025-11-01 08:52:00 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/ukh-326-leather-holster-ph-732149> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/ukh-326-leather-holster-ph-732149 returned 404 status code.
2025-11-01 08:52:00 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/vinyl-gloves-3-mil-powder-free-m-ph-891357> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/vinyl-gloves-3-mil-powder-free-m-ph-891357 returned 404 status code.
2025-11-01 08:52:00 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wd-40-11-oz-spray-can-w-smart-straw-ph-845017> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wd-40-11-oz-spray-can-w-smart-straw-ph-845017 returned 404 status code.
2025-11-01 08:52:00 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/virtua-clear-temples-protective-eyewear-ph-722105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/virtua-clear-temples-protective-eyewear-ph-722105 returned 404 status code.
2025-11-01 08:52:00 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-l-ph-891375> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-l-ph-891375 returned 404 status code.
2025-11-01 08:52:00 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-m-ph-891373> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-m-ph-891373 returned 404 status code.
2025-11-01 08:52:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1-4-x-2-sample-fluorescent-yellow-labels-ph-411305>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:01 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-50-fluorescent-orange-cable-ties-ph-441141>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:02 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wire-shelving-s-hooks-ph-715393> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wire-shelving-s-hooks-ph-715393 returned 404 status code.
2025-11-01 08:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:03 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/yellow-marsh-88fx-metal-paint-markers-ph-734117> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/yellow-marsh-88fx-metal-paint-markers-ph-734117 returned 404 status code.
2025-11-01 08:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:04 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wypall-floor-jumbo-roll-dispenser-ph-843017> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wypall-floor-jumbo-roll-dispenser-ph-843017 returned 404 status code.
2025-11-01 08:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:04 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wire-shelving-split-sleeves-ph-715395> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wire-shelving-split-sleeves-ph-715395 returned 404 status code.
2025-11-01 08:52:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:05 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wypall-wall-mount-jumbo-roll-dispenser-ph-843019> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wypall-wall-mount-jumbo-roll-dispenser-ph-843019 returned 404 status code.
2025-11-01 08:52:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-11-1-8-x-4-green-shelf-bins-ph-711337> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-11-1-8-x-4-green-shelf-bins-ph-711337 returned 404 status code.
2025-11-01 08:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-11-1-8-x-4-yellow-shelf-bins-ph-711341> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-11-1-8-x-4-yellow-shelf-bins-ph-711341 returned 404 status code.
2025-11-01 08:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-2-3-4-x-4-green-shelf-bins-ph-711299> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-2-3-4-x-4-green-shelf-bins-ph-711299 returned 404 status code.
2025-11-01 08:52:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-16-x-48-x-1250-perforated-foam-roll-ph-541165>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-7-8-x-11-7-8-corrugated-layer-pads-ph-112135>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-6-5-8-x-4-clear-shelf-bins-ph-711317> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-6-5-8-x-4-clear-shelf-bins-ph-711317 returned 404 status code.
2025-11-01 08:52:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-2-3-4-x-4-red-shelf-bins-ph-711301> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-2-3-4-x-4-red-shelf-bins-ph-711301 returned 404 status code.
2025-11-01 08:52:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-x-12-4-mil-flat-poly-bag-ph-311781>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-6-5-8-x-4-yellow-shelf-bins-ph-711323> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-6-5-8-x-4-yellow-shelf-bins-ph-711323 returned 404 status code.
2025-11-01 08:52:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 18349 pages (at 377 pages/min), scraped 7803 items (at 165 items/min)
2025-11-01 08:52:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-6-5-8-x-4-green-shelf-bins-ph-711319> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-6-5-8-x-4-green-shelf-bins-ph-711319 returned 404 status code.
2025-11-01 08:52:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-5-32-black-plastic-twist-ties-ph-345267>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-5-8-x-8-3-8-x-4-red-shelf-bins-ph-711331> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-5-8-x-8-3-8-x-4-red-shelf-bins-ph-711331 returned 404 status code.
2025-11-01 08:52:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-5-yds-gray-3m-4941-vhb-tape-ph-696031>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-60-yds-3m-8898-poly-strapping-tape-ph-643015>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/aluminum-foil-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:21 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:52:21 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:52:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:21 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:52:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:24 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:24 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:52:24 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:26 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:52:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:27 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-36-1-1-2-mil-flat-poly-bag-ph-311945> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-36-1-1-2-mil-flat-poly-bag-ph-311945 returned 404 status code.
2025-11-01 08:52:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-8-1-4-x-9-green-stack-hang-bins-ph-711259> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-8-1-4-x-9-green-stack-hang-bins-ph-711259 returned 404 status code.
2025-11-01 08:52:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:31 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-8-1-4-x-9-clear-stack-hang-bins-ph-711257> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-8-1-4-x-9-clear-stack-hang-bins-ph-711257 returned 404 status code.
2025-11-01 08:52:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-1-2-x-2-yellow-plastic-strap-guards-ph-463039>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:40 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/22-1-2-x-24-1-2-black-can-liners-ph-751141> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/22-1-2-x-24-1-2-black-can-liners-ph-751141 returned 404 status code.
2025-11-01 08:52:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:41 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/225-triangle-entanglement-hazard-durable-safety-label-ph-414109> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/225-triangle-entanglement-hazard-durable-safety-label-ph-414109 returned 404 status code.
2025-11-01 08:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:42 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:52:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-circle-hold-fluorescent-red-labels-ph-412481>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-55-yds-rejected-printed-box-tape-ph-617135>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-55-yds-tan-600-economy-tape-ph-613135>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-55-yds-tan-700-economy-tape-ph-611097>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:52:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/aluminum-foil-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:58 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-60-yds-3m-301+-masking-tape-ph-681749> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-60-yds-3m-301+-masking-tape-ph-681749 returned 404 status code.
2025-11-01 08:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/aluminum-foil-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:01 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:01 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:01 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/aluminum-foil-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:04 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:53:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-x-48-3-mil-flat-poly-bag-ph-312442>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:04 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:53:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:05 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:53:05 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:53:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:06 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:53:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:07 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:53:07 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:53:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 18743 pages (at 394 pages/min), scraped 7960 items (at 157 items/min)
2025-11-01 08:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/37-x-1000-scott-surpass-toliet-tissue-ph-821015> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/37-x-1000-scott-surpass-toliet-tissue-ph-821015 returned 404 status code.
2025-11-01 08:53:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:09 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:53:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:11 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:53:11 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:53:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-fluorescent-pink-rectangle-laser-labels-ph-414423>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:13 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/38-x-48-3-mil-flat-poly-bag-ph-312395> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/38-x-48-3-mil-flat-poly-bag-ph-312395 returned 404 status code.
2025-11-01 08:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:13 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:53:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-fragile-this-side-up-hwc-labels-ph-411789>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:13 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:53:13 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:14 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:53:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:15 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:53:15 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:53:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:19 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:53:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/48-x-40-x-36-easy-load-cargo-container-ph-133101>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:20 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:53:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:22 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-5-premium-anti-fatigue-mat-ph-737423> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-5-premium-anti-fatigue-mat-ph-737423 returned 404 status code.
2025-11-01 08:53:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/48-x-54-6-mil-flat-poly-bag-ph-312479>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/48-x-72-double-wall-corrugated-sheets-ph-112325>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-dark-blue-inventory-circle-labels-ph-412803>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:27 [py.warnings] (PID: 95) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2025-11-01 08:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:27 [scrapy.extensions.feedexport] (PID: 95) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:8
2025-11-01 08:53:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-1-4-x-3-1-8-red-plastic-shipping-tags-pre-wired-ph-427101>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-1-4-x-3-1-8-yellow-13-pt-shipping-tags-ph-423653>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-7-8-x-6-7-8-x-7-7-8-haz-mat-box-ph-151135>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-10-2-mil-flat-poly-bag-ph-311505>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:42 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-shelf-wire-shelving-with-green-bins-ph-715123> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-shelf-wire-shelving-with-green-bins-ph-715123 returned 404 status code.
2025-11-01 08:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:45 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-10-brown-waterhog-mat-ph-737275> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-10-brown-waterhog-mat-ph-737275 returned 404 status code.
2025-11-01 08:53:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-1-2-x-11-white-rectangle-laser-labels-master-case-ph-414699>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-shelf-wire-shelving-with-yellow-bins-ph-715147> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-shelf-wire-shelving-with-yellow-bins-ph-715147 returned 404 status code.
2025-11-01 08:53:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-10-green-waterhog-mat-ph-737277> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-10-green-waterhog-mat-ph-737277 returned 404 status code.
2025-11-01 08:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:50 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/8-1-2-x-11-job-ticket-holders-ph-731107> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/8-1-2-x-11-job-ticket-holders-ph-731107 returned 404 status code.
2025-11-01 08:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-18-1-1-2-mil-flat-poly-bag-ph-311696>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:53:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:56 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-x-16-1-1-2-mil-flat-poly-bag-ph-311695> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-x-16-1-1-2-mil-flat-poly-bag-ph-311695 returned 404 status code.
2025-11-01 08:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:53:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/product/34630>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/product/34645>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/100-jersey-cotton-gloves-large-ph-891425> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/100-jersey-cotton-gloves-large-ph-891425 returned 404 status code.
2025-11-01 08:54:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-clear-stack-hang-bin-ph-711145>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/100-jersey-cotton-gloves-small-ph-891423> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/100-jersey-cotton-gloves-small-ph-891423 returned 404 status code.
2025-11-01 08:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-7-8-x-11-x-5-clear-stack-hang-bins-ph-711187>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 19112 pages (at 369 pages/min), scraped 8120 items (at 160 items/min)
2025-11-01 08:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-red-stack-hang-bin-ph-711151> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-red-stack-hang-bin-ph-711151 returned 404 status code.
2025-11-01 08:54:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-7-8-x-11-x-5-green-stack-hang-bins-ph-711189> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-7-8-x-11-x-5-green-stack-hang-bins-ph-711189 returned 404 status code.
2025-11-01 08:54:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-ivory-stack-hang-bin-ph-711153> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-ivory-stack-hang-bin-ph-711153 returned 404 status code.
2025-11-01 08:54:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/404 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-blue-stack-hang-bin-ph-711157> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-blue-stack-hang-bin-ph-711157 returned 404 status code.
2025-11-01 08:54:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-clear-stack-hang-bin-ph-711159> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-clear-stack-hang-bin-ph-711159 returned 404 status code.
2025-11-01 08:54:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-7-8-x-11-x-5-red-stack-hang-bins-ph-711193> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-7-8-x-11-x-5-red-stack-hang-bins-ph-711193 returned 404 status code.
2025-11-01 08:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-black-conductive-bin-ph-711421> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-black-conductive-bin-ph-711421 returned 404 status code.
2025-11-01 08:54:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/404 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-1-2-x-12-1-2-x-48-telescoping-boxes-ph-116115>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-1-8-x-9-1-4-x-3-white-deluxe-literature-mailer-ph-212207>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/404 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:20 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/12-1-8-x-11-5-8-x-2-5-8-side-loading-mailer-ph-212705> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/12-1-8-x-11-5-8-x-2-5-8-side-loading-mailer-ph-212705 returned 404 status code.
2025-11-01 08:54:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-6-x-6-kraft-gift-box-ph-931205>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-7200-16-x-6-core-polyester-strapping-smooth-ph-473021>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-725-4-mil-black-poly-tubing-ph-353267>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:24 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/404> (failed 3 times): Invalid response, retrying...
2025-11-01 08:54:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/15-x-2150-2-mil-poly-tubing-ph-353289>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/15-x-75ga-reynolon-5044-pvc-shrink-film-ph-383135>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-10-x-3-white-literature-mailers-ph-212575>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:36 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/16-x-11-x-8-black-stack-hang-bins-ph-711247> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/16-x-11-x-8-black-stack-hang-bins-ph-711247 returned 404 status code.
2025-11-01 08:54:36 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/16-x-11-x-8-red-stack-hang-bins-ph-711249> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/16-x-11-x-8-red-stack-hang-bins-ph-711249 returned 404 status code.
2025-11-01 08:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/hook-and-loop-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:56 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:58 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:54:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:01 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:02 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:55:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-110-yds-clear-160-industrial-tape-ph-612049>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:05 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-60-yds-3m-8898-poly-strapping-tape-ph-643043>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:06 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 08:55:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-60-yds-green-10-mil-duct-tape-ph-682047>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:07 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 08:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 19482 pages (at 370 pages/min), scraped 8279 items (at 159 items/min)
2025-11-01 08:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-60-yds-blue-secure-tape-ph-616003> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-60-yds-blue-secure-tape-ph-616003 returned 404 status code.
2025-11-01 08:55:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:10 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:55:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-60-yds-white-masking-tape-ph-681217 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-60-yds-white-masking-tape-ph-681213 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-60-yds-2200-masking-tape-ph-681201 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-60-yds-red-tape-logic-masking-tape-ph-681197 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-60-yds-red-masking-tape-ph-681193 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-60-yds-orange-masking-tape-ph-681189 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-60-yds-orange-masking-tape-ph-681185 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-60-yds-light-green-masking-tape-ph-681181 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-60-yds-light-green-masking-tape-ph-681177 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-60-yds-light-blue-masking-tape-ph-681173 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-60-yds-light-blue-masking-tape-ph-681169 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-60-yds-dark-green-masking-tape-ph-681161 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:15 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/safety-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:55:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-60-yds-dark-green-masking-tape-ph-681165>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-60-yds-black-masking-tape-ph-681155 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:15 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-60-yds-black-masking-tape-ph-681149 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-60-yds-2200-masking-tape-ph-681131 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-4-x-60-yds-yellow-masking-tape-ph-681125 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:16 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-4-x-60-yds-yellow-masking-tape-ph-681119 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:16 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-4-x-60-yds-white-masking-tape-ph-681113 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-4-x-60-yds-white-masking-tape-ph-681107 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-4-x-60-yds-red-tape-logic-masking-tape-ph-681101 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:16 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-4-x-60-yds-red-masking-tape-ph-681095 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-4-x-60-yds-orange-masking-tape-ph-681087 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-4-x-60-yds-orange-masking-tape-ph-681079 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-4-x-60-yds-light-green-masking-tape-ph-681071 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-4-x-60-yds-light-green-masking-tape-ph-681063 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-4-x-60-yds-dark-green-masking-tape-ph-681039 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-4-x-60-yds-dark-green-masking-tape-ph-681029 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-4-x-60-yds-light-blue-masking-tape-ph-681055>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-4-x-60-yds-light-blue-masking-tape-ph-681047>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-4-x-60-yds-black-masking-tape-ph-681019 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-4-x-60-yds-black-masking-tape-ph-681009 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:20 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:55:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:20 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-in-1-safety-cutter-right-handed-ph-732151>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3m-5n11-filter-particulate-air-n95-ph-723103>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3m-6200-half-face-respirator-medium-ph-723109>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3m-707-label-protection-tape-dispenser-ph-692001>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3m-8330-carrying-handles-1-3-8-x-23-ph-693025>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3m-bumpon-clear-dome-7-16-x-13-64-ph-638009>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/retail-packaging>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3m-replacement-blade-for-c22-dispenser-ph-666055>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3m-replacement-blade-for-m75-dispenser-ph-666063>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-in-1-safety-cutter-left-handed-ph-732155> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-in-1-safety-cutter-left-handed-ph-732155 returned 404 status code.
2025-11-01 08:55:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:31 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:55:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:33 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-5-slip-guard-drainage-mat-ph-737150> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-5-slip-guard-drainage-mat-ph-737150 returned 404 status code.
2025-11-01 08:55:33 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-adhesive-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:37 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:55:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:38 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-60-red-economy-vinyl-carpet-mat-ph-737547> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-60-red-economy-vinyl-carpet-mat-ph-737547 returned 404 status code.
2025-11-01 08:55:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-1075-4-mil-poly-tubing-ph-353147>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:41 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:55:41 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:55:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-145-yds-3m-3765-label-protection-ph-694003>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:45 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-12-6-mil-reclosable-poly-bag-ph-315377> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-12-6-mil-reclosable-poly-bag-ph-315377 returned 404 status code.
2025-11-01 08:55:45 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:55:45 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:55:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:46 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-12-red-black-waterhog-mat-ph-737256> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-12-red-black-waterhog-mat-ph-737256 returned 404 status code.
2025-11-01 08:55:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-12-green-waterhog-mat-ph-737253> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-12-green-waterhog-mat-ph-737253 returned 404 status code.
2025-11-01 08:55:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-16-red-black-waterhog-mat-ph-737262> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-16-red-black-waterhog-mat-ph-737262 returned 404 status code.
2025-11-01 08:55:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-16-navy-waterhog-mat-ph-737261> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-16-navy-waterhog-mat-ph-737261 returned 404 status code.
2025-11-01 08:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-3-4-x-2-7-8-yellow-13-pt-shipping-tags-pre-wired-ph-423561>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-12-1-1-2-mil-flat-poly-bag-ph-311483>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:55 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-green-stack-hang-bin-ph-711105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-green-stack-hang-bin-ph-711105 returned 404 status code.
2025-11-01 08:55:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-12-2-mil-flat-poly-bag-ph-311509>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-15-6-mil-anti-static-flat-poly-bag-ph-331313>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:58 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-12-navy-waterhog-mat-ph-737285> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-12-navy-waterhog-mat-ph-737285 returned 404 status code.
2025-11-01 08:55:58 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-12-charcoal-waterhog-mat-ph-737282> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-12-charcoal-waterhog-mat-ph-737282 returned 404 status code.
2025-11-01 08:55:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-30-2-mil-reclosable-poly-bag-ph-315342>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-corrugated-bin-dividers-ph-175105>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:55:58 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-16-navy-waterhog-mat-ph-737291> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-16-navy-waterhog-mat-ph-737291 returned 404 status code.
2025-11-01 08:55:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:55:59 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-20-green-waterhog-runner-ph-737301> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-20-green-waterhog-runner-ph-737301 returned 404 status code.
2025-11-01 08:55:59 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-16-red-black-waterhog-mat-ph-737292> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-16-red-black-waterhog-mat-ph-737292 returned 404 status code.
2025-11-01 08:56:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:01 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/8-pt-steel-track-utility-knife-w-grip-ph-732135> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/8-pt-steel-track-utility-knife-w-grip-ph-732135 returned 404 status code.
2025-11-01 08:56:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:03 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-20-red-black-waterhog-runner-ph-737304> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-20-red-black-waterhog-runner-ph-737304 returned 404 status code.
2025-11-01 08:56:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-9-4-mil-reclosable-poly-bag-ph-315158>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-9-x-9-double-wall-boxes-ph-115555>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 19883 pages (at 401 pages/min), scraped 8433 items (at 154 items/min)
2025-11-01 08:56:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/angel-soft-toliet-tissue-dispenser-pack-ph-824001> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/angel-soft-toliet-tissue-dispenser-pack-ph-824001 returned 404 status code.
2025-11-01 08:56:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/ansell-tnt-nitrile-gloves-xlarge-ph-891015> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/ansell-tnt-nitrile-gloves-xlarge-ph-891015 returned 404 status code.
2025-11-01 08:56:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/brute-domed-trash-can-lid-32-gal-blue-ph-743201>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:13 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/ambidextrous-spring-back-safety-cutter-ph-732195> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/ambidextrous-spring-back-safety-cutter-ph-732195 returned 404 status code.
2025-11-01 08:56:13 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/bc-347-safety-bag-cutter-ph-732199> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/bc-347-safety-bag-cutter-ph-732199 returned 404 status code.
2025-11-01 08:56:13 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/best-nighthawk-nitrile-gloves-small-ph-891041> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/best-nighthawk-nitrile-gloves-small-ph-891041 returned 404 status code.
2025-11-01 08:56:13 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/banding-and-strapping-safety-cutter-ph-732197> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/banding-and-strapping-safety-cutter-ph-732197 returned 404 status code.
2025-11-01 08:56:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-1075-4-mil-poly-tubing-ph-353245>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/black-sharpie-fine-point-markers-ph-734121> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/black-sharpie-fine-point-markers-ph-734121 returned 404 status code.
2025-11-01 08:56:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/water-activated-tape-dispensers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/ansell-touch-n-tuff-nitrile-gloves-m-ph-891019> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/ansell-touch-n-tuff-nitrile-gloves-m-ph-891019 returned 404 status code.
2025-11-01 08:56:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/blade-bank-ph-732207> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/blade-bank-ph-732207 returned 404 status code.
2025-11-01 08:56:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/ansell-conform-xt-latex-exam-glove-l-ph-891005> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/ansell-conform-xt-latex-exam-glove-l-ph-891005 returned 404 status code.
2025-11-01 08:56:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/box-of-rags-premium-white-50-lb-box-ph-827029> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/box-of-rags-premium-white-50-lb-box-ph-827029 returned 404 status code.
2025-11-01 08:56:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-flat-trash-can-lid-44-gal-black-ph-743243> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-flat-trash-can-lid-44-gal-black-ph-743243 returned 404 status code.
2025-11-01 08:56:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-flat-trash-can-lid-44-gal-green-ph-743247> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-flat-trash-can-lid-44-gal-green-ph-743247 returned 404 status code.
2025-11-01 08:56:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-domed-trash-can-lid-44-gal-blue-ph-743237> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-domed-trash-can-lid-44-gal-blue-ph-743237 returned 404 status code.
2025-11-01 08:56:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-flat-trash-can-lid-20-gallon-blue-ph-743175> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-flat-trash-can-lid-20-gallon-blue-ph-743175 returned 404 status code.
2025-11-01 08:56:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:22 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/12-1-8-x-9-1-4-x-5-kraft-deluxe-literature-mailer-ph-212213> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/12-1-8-x-9-1-4-x-5-kraft-deluxe-literature-mailer-ph-212213 returned 404 status code.
2025-11-01 08:56:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:25 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/12-1-8-x-9-x-2-1-2-side-loading-mailer-ph-212703> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/12-1-8-x-9-x-2-1-2-side-loading-mailer-ph-212703 returned 404 status code.
2025-11-01 08:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-9-job-ticket-holders-ph-731139>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/12-x-900-parcel-ready-perforated-foam-roll-ph-541137 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:39 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/13-15-16-x-4-3-4-stack-hang-dividers-ph-712113> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/13-15-16-x-4-3-4-stack-hang-dividers-ph-712113 returned 404 status code.
2025-11-01 08:56:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-12-x-4-flat-corrugated-boxes-ph-101685>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-12-x-8-corrugated-boxes-ph-101691>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-12-x-8-heavy-duty-boxes-ph-115195>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-16-x-10-corrugated-boxes-ph-101713>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-36-yds-black-yellow-striped-vinyl-safety-tape-ph-631031>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/vinyl-safety-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-36-yds-red-3-pack-3m-471-vinyl-tape-ph-631325>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-3-4-x-1-3-8-red-13-pt-shipping-tags-ph-423065>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:56:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/23-5-8-x-4-1-8-x-4-red-shelf-bins-ph-711387>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:56:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:56:55 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:56:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-250-jumbo-cable-ties-natural-ph-442015>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:57 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:56:57 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/23-5-8-x-6-5-8-x-4-blue-shelf-bins-ph-711391> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/23-5-8-x-6-5-8-x-4-blue-shelf-bins-ph-711391 returned 404 status code.
2025-11-01 08:56:57 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/23-5-8-x-8-3-8-x-4-clear-shelf-bins-ph-711403> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/23-5-8-x-8-3-8-x-4-clear-shelf-bins-ph-711403 returned 404 status code.
2025-11-01 08:56:57 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/23-5-8-x-8-3-8-x-4-yellow-shelf-bins-ph-711409> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/23-5-8-x-8-3-8-x-4-yellow-shelf-bins-ph-711409 returned 404 status code.
2025-11-01 08:56:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:58 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:56:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-110-yds-fragile-handle-with-care-printed-tape-ph-617021>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:56:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:58 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:56:58 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/23-5-8-x-8-3-8-4-red-shelf-bins-ph-711407> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/23-5-8-x-8-3-8-4-red-shelf-bins-ph-711407 returned 404 status code.
2025-11-01 08:56:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:56:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:01 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:03 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:57:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-12-2-mil-reclosable-poly-bag-ph-315077>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/carton-sealing-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 20272 pages (at 389 pages/min), scraped 8596 items (at 163 items/min)
2025-11-01 08:57:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/carton-sealing-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/carton-sealing-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/hook-and-loop-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/30--50-lb-bogus-kraft-paper-rolls-ph-512229>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3.14-x-1476-black-zebra-thermal-transfer-ribbons-wax-ph-415129> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3.14-x-1476-black-zebra-thermal-transfer-ribbons-wax-ph-415129 returned 404 status code.
2025-11-01 08:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/30-x-24-x-12-corrugated-boxes-ph-102751>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:19 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-10-black-yellow-anti-fatigue-mat-ph-737366> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-10-black-yellow-anti-fatigue-mat-ph-737366 returned 404 status code.
2025-11-01 08:57:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:19 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-10-burgundy-deluxe-entry-mat-ph-737453> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-10-burgundy-deluxe-entry-mat-ph-737453 returned 404 status code.
2025-11-01 08:57:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-110-yds-clear-6651-cold-temperature-tape-ph-614025>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:19 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:57:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:20 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-10-brown-waterhog-elite-mat-ph-737399> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-10-brown-waterhog-elite-mat-ph-737399 returned 404 status code.
2025-11-01 08:57:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-60-yds-white-11-mil-gaffers-tape-ph-693139>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:22 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-10-green-waterhog-mat-ph-737205> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-10-green-waterhog-mat-ph-737205 returned 404 status code.
2025-11-01 08:57:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-6-charcoal-superior-vinyl-carpet-ph-737490>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:24 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:57:24 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-8-black-economy-anti-fatigue-mat-ph-737335> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-8-black-economy-anti-fatigue-mat-ph-737335 returned 404 status code.
2025-11-01 08:57:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-6-white-tubes-with-caps-ph-213559>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-8-1-1-2-mil-flat-poly-bag-ph-311143>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-1-white-removable-rectangle-laser-labels-ph-414521>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:29 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:57:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:31 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-8-premium-anti-fatigue-mat-ph-737429> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-8-premium-anti-fatigue-mat-ph-737429 returned 404 status code.
2025-11-01 08:57:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:32 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-8-red-black-waterhog-mat-ph-737202> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-8-red-black-waterhog-mat-ph-737202 returned 404 status code.
2025-11-01 08:57:32 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-8-black-economy-anti-fatigue-mat-ph-737359> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-8-black-economy-anti-fatigue-mat-ph-737359 returned 404 status code.
2025-11-01 08:57:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:33 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-20-brown-waterhog-runner-ph-737293> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-20-brown-waterhog-runner-ph-737293 returned 404 status code.
2025-11-01 08:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-8-x-75-hook-white-velcro-tape-strips-ph-673113>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-plastic-end-caps-ph-213813>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-shelf-wire-shelving-with-yellow-bins-ph-715163> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-shelf-wire-shelving-with-yellow-bins-ph-715163 returned 404 status code.
2025-11-01 08:57:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/hook-and-loop-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-4-x-1-white-corrugated-mailers-ph-211219>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-10-top-load-freight-only-fluorescent-red-labels-ph-411753>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:56 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:57:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-14-3-mil-reclosable-amber-uv-bags-ph-332109>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:57:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-18-8-mil-reclosable-poly-bag-ph-315335>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-20-3-mil-flat-poly-bag-ph-311669>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:04 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-square-can-flat-lid-40-gal-gray-ph-743117> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-square-can-flat-lid-40-gal-gray-ph-743117 returned 404 status code.
2025-11-01 08:58:04 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-square-trash-can-28-gallon-gray-ph-743101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-square-trash-can-28-gallon-gray-ph-743101 returned 404 status code.
2025-11-01 08:58:05 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-roll-out-container-50-gallon-gray-ph-747101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-roll-out-container-50-gallon-gray-ph-747101 returned 404 status code.
2025-11-01 08:58:05 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-square-dolly-ph-743121> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-square-dolly-ph-743121 returned 404 status code.
2025-11-01 08:58:05 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-square-trash-can-28-gallon-red-ph-743103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-square-trash-can-28-gallon-red-ph-743103 returned 404 status code.
2025-11-01 08:58:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/casters-for-vertical-roll-paper-cutter-ph-516113>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/cotton-inspection-gloves-25-oz-large-ph-891229>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-steel-dome-lid-55-gallon-red-ph-743293> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-steel-dome-lid-55-gallon-red-ph-743293 returned 404 status code.
2025-11-01 08:58:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/elevator-9-x-6-facility-sign-ph-781165>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-trash-can-10-gallon-yellow-ph-743143> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-trash-can-10-gallon-yellow-ph-743143 returned 404 status code.
2025-11-01 08:58:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/environmentally-friendly-loose-fill-ph-551107>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-trash-can-44-gallon-green-ph-743227> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-trash-can-44-gallon-green-ph-743227 returned 404 status code.
2025-11-01 08:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-steel-dome-lid-55-gallon-green-ph-743291> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-steel-dome-lid-55-gallon-green-ph-743291 returned 404 status code.
2025-11-01 08:58:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/contractors-bag-black-33-gallon-30-mil-ph-756103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/contractors-bag-black-33-gallon-30-mil-ph-756103 returned 404 status code.
2025-11-01 08:58:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-trash-can-10-gallon-white-ph-743141> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-trash-can-10-gallon-white-ph-743141 returned 404 status code.
2025-11-01 08:58:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-trash-can-55-gallon-blue-ph-743259> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-trash-can-55-gallon-blue-ph-743259 returned 404 status code.
2025-11-01 08:58:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/brute-trash-can-10-gallon-red-ph-743139> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/brute-trash-can-10-gallon-red-ph-743139 returned 404 status code.
2025-11-01 08:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:07 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/safety-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:58:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/donut-bumpers-for-swivel-casters-ph-715391> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/donut-bumpers-for-swivel-casters-ph-715391 returned 404 status code.
2025-11-01 08:58:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/contractors-bag-black-30-gallon-30-mil-ph-756101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/contractors-bag-black-30-gallon-30-mil-ph-756101 returned 404 status code.
2025-11-01 08:58:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/cotton-inspection-gloves-35-oz-large-ph-891235> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/cotton-inspection-gloves-35-oz-large-ph-891235 returned 404 status code.
2025-11-01 08:58:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/deerskin-leather-drivers-gloves-large-ph-891297> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/deerskin-leather-drivers-gloves-large-ph-891297 returned 404 status code.
2025-11-01 08:58:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/e-a-r-earmuffs-ph-725121> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/e-a-r-earmuffs-ph-725121 returned 404 status code.
2025-11-01 08:58:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 20676 pages (at 404 pages/min), scraped 8774 items (at 178 items/min)
2025-11-01 08:58:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/door-sign-employees-only-ph-781185> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/door-sign-employees-only-ph-781185 returned 404 status code.
2025-11-01 08:58:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/door-sign-watch-your-step-ph-781201> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/door-sign-watch-your-step-ph-781201 returned 404 status code.
2025-11-01 08:58:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-12-black-yellow-anti-fatigue-mat-ph-737369> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-12-black-yellow-anti-fatigue-mat-ph-737369 returned 404 status code.
2025-11-01 08:58:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/dixie-paper-plates-10-1-4-heavyweight-ph-882101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/dixie-paper-plates-10-1-4-heavyweight-ph-882101 returned 404 status code.
2025-11-01 08:58:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/cotton-inspection-ext-cuff-glove-l-ph-891231> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/cotton-inspection-ext-cuff-glove-l-ph-891231 returned 404 status code.
2025-11-01 08:58:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-16-brown-waterhog-mat-ph-737215> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-16-brown-waterhog-mat-ph-737215 returned 404 status code.
2025-11-01 08:58:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-16-green-waterhog-mat-ph-737217> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-16-green-waterhog-mat-ph-737217 returned 404 status code.
2025-11-01 08:58:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-20-green-waterhog-runner-ph-737307> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-20-green-waterhog-runner-ph-737307 returned 404 status code.
2025-11-01 08:58:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:21 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/40-x-46-black-can-liners-ph-751173> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/40-x-46-black-can-liners-ph-751173 returned 404 status code.
2025-11-01 08:58:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-36-kraft-premium-telescoping-tubes-ph-213739>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:24 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/40-x-46-black-can-liners-ph-751179> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/40-x-46-black-can-liners-ph-751179 returned 404 status code.
2025-11-01 08:58:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:27 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-3-4-methanol-labels-ph-413131>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-4-mil-reclosable-poly-bag-w-hang-hole-ph-315228>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-caution-moisture-sensitive-devices-labels-ph-411623>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-3-x-15-1-1-2-mil-gusseted-polypropylene-bags-ph-354203>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-5-4-mil-flat-poly-bag-ph-311344>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:41 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-x-24-2-mil-reclosable-poly-bag-ph-315321> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-x-24-2-mil-reclosable-poly-bag-ph-315321 returned 404 status code.
2025-11-01 08:58:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-6-x-4-multi-depth-corrugated-boxes-ph-113299>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/safety-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-5-32-black-paper-twist-ties-ph-345195>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-60ga-x-4375-poly-olefin-shrink-film-ph-384103>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:58:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:58:59 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/safety-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:58:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:00 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/esd-fingertip-coated-nylon-gloves-l-ph-891079> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/esd-fingertip-coated-nylon-gloves-l-ph-891079 returned 404 status code.
2025-11-01 08:59:00 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/esd-uncoated-nylon-gloves-small-ph-891069> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/esd-uncoated-nylon-gloves-small-ph-891069 returned 404 status code.
2025-11-01 08:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:01 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/ez4-guarded-spring-back-safety-cutter-ph-732103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/ez4-guarded-spring-back-safety-cutter-ph-732103 returned 404 status code.
2025-11-01 08:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:01 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/fluorescent-orange-sharpie-highlighters-ph-734167> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/fluorescent-orange-sharpie-highlighters-ph-734167 returned 404 status code.
2025-11-01 08:59:01 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/heavy-duty-handled-stretch-film-dispenser-ph-341119>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:01 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-light-duty-glue-applicator-ph-675009>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:01 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/goatskin-leather-drivers-gloves-large-ph-891279> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/goatskin-leather-drivers-gloves-large-ph-891279 returned 404 status code.
2025-11-01 08:59:01 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/gojo-nxt-maximum-capacity-dispenser-ph-846009> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/gojo-nxt-maximum-capacity-dispenser-ph-846009 returned 404 status code.
2025-11-01 08:59:02 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/gritless-sweeping-compound-200-lb-bag-ph-842007> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/gritless-sweeping-compound-200-lb-bag-ph-842007 returned 404 status code.
2025-11-01 08:59:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:02 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 08:59:02 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hands-free-trash-can-lid-23-gallon-beige-ph-746115> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hands-free-trash-can-lid-23-gallon-beige-ph-746115 returned 404 status code.
2025-11-01 08:59:02 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hands-free-trash-can-lid-35-gallon-gray-ph-746107> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hands-free-trash-can-lid-35-gallon-gray-ph-746107 returned 404 status code.
2025-11-01 08:59:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-12-orange-important-papers-enclosed-envelopes-ph-455031>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-12-orange-packing-list-enclosed-envelopes-ph-451059>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:02 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-black-60-gallon-67-mil-ph-754161> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-black-60-gallon-67-mil-ph-754161 returned 404 status code.
2025-11-01 08:59:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-12-x-4-1-2-white-bin-boxes-ph-171177>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:03 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/kimtech-12-x-168-prep-dispenser-box-wipers-ph-844031> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/kimtech-12-x-168-prep-dispenser-box-wipers-ph-844031 returned 404 status code.
2025-11-01 08:59:03 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/kimwipes-3-ply-118-x-118-low-lint-wipers-ph-844019> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/kimwipes-3-ply-118-x-118-low-lint-wipers-ph-844019 returned 404 status code.
2025-11-01 08:59:03 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-black-56-gallon-67-mil-ph-754153> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-black-56-gallon-67-mil-ph-754153 returned 404 status code.
2025-11-01 08:59:03 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-natural-60-gallon-86-mil-ph-754133> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-natural-60-gallon-86-mil-ph-754133 returned 404 status code.
2025-11-01 08:59:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:04 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-black-40-45-gallon-86-mil-ph-754149> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-black-40-45-gallon-86-mil-ph-754149 returned 404 status code.
2025-11-01 08:59:05 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/hd-trash-bag-natural-40-45-gal-55-mil-ph-754119> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/hd-trash-bag-natural-40-45-gal-55-mil-ph-754119 returned 404 status code.
2025-11-01 08:59:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-15-2-mil-flat-suffocation-warning-poly-bag-ph-335153>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-15-2-mil-poly-bag-on-a-roll-ph-314333>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 21064 pages (at 388 pages/min), scraped 8941 items (at 167 items/min)
2025-11-01 08:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-100-6-mil-black-poly-sheeting-ph-352159>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:13 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/12-wide-seal-foot-operated-impulse-sealer-ph-344127> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/12-wide-seal-foot-operated-impulse-sealer-ph-344127 returned 404 status code.
2025-11-01 08:59:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/13-x-13-3-mil-flat-poly-bag-ph-312119>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/13-x-17-1-2-gold-glamour-bubble-mailers-ph-242167>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-18-4-mil-flat-poly-bag-ph-311819>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:23 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/13-x-16-3-mil-flat-poly-bag-ph-311957> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/13-x-16-3-mil-flat-poly-bag-ph-311957 returned 404 status code.
2025-11-01 08:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:26 [py.warnings] (PID: 95) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2025-11-01 08:59:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-24-4-mil-flat-poly-bag-ph-311828>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:27 [scrapy.extensions.feedexport] (PID: 95) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:9
2025-11-01 08:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/16-x-4-x-4-kraft-corrugated-mailers-ph-211639>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:28 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/16-x-22-3-mil-flat-poly-bag-ph-311969> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/16-x-22-3-mil-flat-poly-bag-ph-311969 returned 404 status code.
2025-11-01 08:59:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:29 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:59:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/17-1-2-x-14-3-4-x-12-1-2-corrugated-box-ph-101831>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-60-yds-3m-2380-masking-tape-ph-681597>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:37 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-x-60-yds-13m-501+-masking-tape-ph-681545> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-x-60-yds-13m-501+-masking-tape-ph-681545 returned 404 status code.
2025-11-01 08:59:37 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 08:59:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-12-x-12-heavy-duty-boxes-ph-115349>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:42 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/safety-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:43 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-16-x-16-double-wall-boxes-ph-115363>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:44 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:59:44 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:44 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:44 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-18-x-8-corrugated-boxes-ph-102403>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:45 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/safety-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-16-4-mil-flat-poly-bag-ph-311074>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-18-gold-tubes-with-caps-ph-213193>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:59:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:59:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:59:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-18-yds-3m-4004-double-sided-foam-tape-ph-652201>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:59:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-24-gold-tubes-with-caps-ph-213241>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-2-pictogram-flame-over-circle-labels-ph-413129>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:53 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:59:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-2-sensitive-electronic-devices-fluor-yellow-labels-ph-411531>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/30-x-30-x-20-double-wall-boxes-ph-115455>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 08:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:57 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 08:59:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 08:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/30-x-6-x-24-side-loading-boxes-ph-115461>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:03 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/30-x-36-clear-can-liners-ph-751109> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/30-x-36-clear-can-liners-ph-751109 returned 404 status code.
2025-11-01 09:00:03 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/30-x-36-black-can-liners-ph-751151> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/30-x-36-black-can-liners-ph-751151 returned 404 status code.
2025-11-01 09:00:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-1-16-x-2-1-8-x-1-white-jewelry-box-ph-933107>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-1-2-c-vinyl-warehouse-letter-labels-ph-417031>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-15-kraft-clasp-envelopes-ph-281233>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:05 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/30-x-60-3-mil-flat-poly-bag-ph-312392> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/30-x-60-3-mil-flat-poly-bag-ph-312392 returned 404 status code.
2025-11-01 09:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-17--1-1-2-mil-doorknob-poly-bag-ph-321119>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-20-4-mil-reclosable-poly-bag-ph-315445>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-24-moisture-barrier-bags-ph-333129>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 21468 pages (at 404 pages/min), scraped 9108 items (at 167 items/min)
2025-11-01 09:00:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-4-x-20-1-mil-gusseted-poly-bag-ph-318353>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-4-x-20-2-mil-gusseted-poly-bag-ph-318371>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-12-2-mil-white-block-reclosable-poly-bag-ph-317219>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-12-4-mil-double-track-reclosable-poly-bag-ph-315234>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-12-reclosable-static-shielding-bags-ph-334317>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-1-2-x-14-1-2-x-40-telescoping-boxes-ph-116127>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/404 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-1-2-x-8-3-4-x-12-corrugated-boxes-ph-101551>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-green-stack-hang-bin-ph-711203>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:26 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-red-stack-hang-bin-ph-711235> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-red-stack-hang-bin-ph-711235 returned 404 status code.
2025-11-01 09:00:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-50-gray-cable-ties-ph-441197>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:26 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-yellow-stack-hang-bin-ph-711239> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-yellow-stack-hang-bin-ph-711239 returned 404 status code.
2025-11-01 09:00:26 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-red-stack-hang-bin-ph-711221> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-red-stack-hang-bin-ph-711221 returned 404 status code.
2025-11-01 09:00:26 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-clear-stack-hang-bin-ph-711201> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-clear-stack-hang-bin-ph-711201 returned 404 status code.
2025-11-01 09:00:26 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-yellow-stack-hang-bin-ph-711225> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-yellow-stack-hang-bin-ph-711225 returned 404 status code.
2025-11-01 09:00:26 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-green-stack-hang-bin-ph-711231> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-green-stack-hang-bin-ph-711231 returned 404 status code.
2025-11-01 09:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/404 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-black-stack-hang-bin-ph-711233> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-black-stack-hang-bin-ph-711233 returned 404 status code.
2025-11-01 09:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:30 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-7-8-x-4-1-8-x-4-clear-shelf-bins-ph-711345> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-7-8-x-4-1-8-x-4-clear-shelf-bins-ph-711345 returned 404 status code.
2025-11-01 09:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/404 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:31 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-7-8-x-6-5-8-x-4-yellow-shelf-bins-ph-711361> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-7-8-x-6-5-8-x-4-yellow-shelf-bins-ph-711361 returned 404 status code.
2025-11-01 09:00:31 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-7-8-x-6-5-8-x-4-green-shelf-bins-ph-711357> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-7-8-x-6-5-8-x-4-green-shelf-bins-ph-711357 returned 404 status code.
2025-11-01 09:00:31 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-7-8-x-4-1-8-x-4-blue-shelf-bins-ph-711343> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-7-8-x-4-1-8-x-4-blue-shelf-bins-ph-711343 returned 404 status code.
2025-11-01 09:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:33 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-x-14-1-2-blue-stack-nest-lids-ph-717145> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-x-14-1-2-blue-stack-nest-lids-ph-717145 returned 404 status code.
2025-11-01 09:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:33 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/404> (failed 3 times): Invalid response, retrying...
2025-11-01 09:00:33 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-x-14-1-2-x-9-7-8-blue-stack-nest-bin-ph-717115> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-x-14-1-2-x-9-7-8-blue-stack-nest-bin-ph-717115 returned 404 status code.
2025-11-01 09:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-60-yds-3m-927-adhesive-transfer-tape-hand-rolls-ph-651053>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:34 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-x-60-yds-3m-401+-233+-masking-tape-ph-681543> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-x-60-yds-3m-401+-233+-masking-tape-ph-681543 returned 404 status code.
2025-11-01 09:00:34 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-x-60-yds-3m-401+-233+-masking-tape-ph-681607> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-x-60-yds-3m-401+-233+-masking-tape-ph-681607 returned 404 status code.
2025-11-01 09:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/aluminum-foil-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-60-yds-dark-green-masking-tape-ph-681353>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-60-yds-red-11-mil-gaffers-tape-ph-693011>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-x-72-yds-3m-9425-removable-double-sided-film-tape-ph-653087>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:38 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/20-1-4-x-14-1-4-x-9-5-8-round-trip-tote-ph-717101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/20-1-4-x-14-1-4-x-9-5-8-round-trip-tote-ph-717101 returned 404 status code.
2025-11-01 09:00:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:42 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/24-x-23-clear-can-liners-ph-751101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/24-x-23-clear-can-liners-ph-751101 returned 404 status code.
2025-11-01 09:00:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-24-6-mil-reclosable-poly-bag-ph-315607>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-24-poly-mailers-ph-221141>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:43 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:00:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:46 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/specialty-tapes already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-2-x-40-225-edge-protectors-cased-ph-461035>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:47 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/specialty-tapes> (failed 3 times): Invalid response, retrying...
2025-11-01 09:00:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-2-x-72-p120-edge-protectors-skid-lot-ph-462053>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:49 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/specialty-tapes> (failed 3 times): Invalid response, retrying...
2025-11-01 09:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/industrial-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-2-mil-yellow-reclosable-poly-bag-ph-315028>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:00:59 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-1-2-x-5-glossy-white-rectangle-laser-labels-ph-414377>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-1-4-x-1-5-8-red-tyvek-shipping-tag-ph-424039>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-1-4-x-1-5-8-yellow-13-pt-shipping-tags-pre-strung-ph-423149>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-26-2-mil-flat-poly-bag-ph-311189>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-2-x-8-2-mil-gusseted-poly-bag-ph-318101>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 21859 pages (at 391 pages/min), scraped 9276 items (at 168 items/min)
2025-11-01 09:01:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-36-green-tubes-with-caps-ph-213523>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-1-2-x-6-orange-important-papers-enclosed-envelopes-ph-453007>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-1-4-x-2-1-8-13-pt-manila-shipping-tags-pre-wired-ph-422045>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-1-4-x-2-1-8-green-13-pt-shipping-tags-ph-423275>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-marine-pollutant-labels-ph-413213>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-spontaneously-combustible-4-labels-ph-413179>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-4-x-37-white-square-mailing-tubes-ph-213621>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-5-x-4-corrugated-boxes-ph-103031>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-72-kraft-jumbo-tubes-ph-213687>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-7-chipboard-pads-ph-481001>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:33 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/5-x-5-x-25-kraft-square-mailing-tubes-ph-213657> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/5-x-5-x-25-kraft-square-mailing-tubes-ph-213657 returned 404 status code.
2025-11-01 09:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-80ga-blue-bundling-stretch-film-ph-361153>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-8-1-mil-poly-bag-on-a-roll-ph-314275>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-x-8-2-mil-poly-bag-on-a-roll-ph-314279>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:41 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/6-x-8-red-black-waterhog-mat-ph-737274> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/6-x-8-red-black-waterhog-mat-ph-737274 returned 404 status code.
2025-11-01 09:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-6-3-mil-slide-seal-white-block-poly-bag-ph-317177>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-8-x-17-tall-corrugated-boxes-ph-103207>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/8-x-8-x-4-kraft-corrugated-mailers-ph-211433>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/kraft-1-self-seal-bubble-mailer-w-tear-strip-ph-241165>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/kraft-25-pk-6-heat-seal-bubble-mailer-ph-241259>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/kraft-3-self-seal-bubble-mailer-tear-strip-ph-241205>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:02 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/latex-glove-powder-free-w-extended-cuff-xl-ph-891171> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/latex-glove-powder-free-w-extended-cuff-xl-ph-891171 returned 404 status code.
2025-11-01 09:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:02 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/latex-industrial-gloves-large-ph-891151> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/latex-industrial-gloves-large-ph-891151 returned 404 status code.
2025-11-01 09:02:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/marsh-td2100-electric-dispenser-ph-625041>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:03 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/latex-industrial-gloves-xlarge-ph-891153> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/latex-industrial-gloves-xlarge-ph-891153 returned 404 status code.
2025-11-01 09:02:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:04 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/lined-jersey-cotton-gloves-large-ph-891427> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/lined-jersey-cotton-gloves-large-ph-891427 returned 404 status code.
2025-11-01 09:02:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-6-x-18-2-mil-gusseted-poly-bag-ph-318375>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/water-activated-tape-dispensers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:05 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/men-restroom-ada-compliant-plastic-sign-ph-781105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/men-restroom-ada-compliant-plastic-sign-ph-781105 returned 404 status code.
2025-11-01 09:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/liners-for-swing-top-sanitary-receptacle-ph-825009> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/liners-for-swing-top-sanitary-receptacle-ph-825009 returned 404 status code.
2025-11-01 09:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 22230 pages (at 371 pages/min), scraped 9449 items (at 173 items/min)
2025-11-01 09:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/10-x-5-32-blue-paper-twist-ties-ph-345101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/10-x-5-32-blue-paper-twist-ties-ph-345101 returned 404 status code.
2025-11-01 09:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-8-x-6-corrugated-boxes-ph-101087>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/10-x-9-x-4-white-literature-mailer-ph-212439>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12x15-1-2-pink-poly-mailers-ph-221170>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-15-4-mil-reclosable-poly-bag-ph-315482>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-15-4-mil-white-block-reclosable-poly-bag-ph-317231>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-2-x-15-clear-glue-sticks-ph-676005>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-4-high-tack-glue-dots-low-profile-ph-671041>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-11-x-3-flat-corrugated-boxes-ph-101469>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-12-x-14-corrugated-boxes-ph-101481>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-12-x-6-corrugated-boxes-ph-101489>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-12-x-9-corrugated-boxes-ph-101493>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-14-x-26-3-mil-gusseted-poly-bag-ph-318489>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-14-x-4-flat-corrugated-boxes-ph-101521>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-14-x-4-white-deluxe-literature-mailer-ph-212251>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:35 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/17-x-8-1-4-stack-hang-bin-dividers-ph-712115> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/17-x-8-1-4-stack-hang-bin-dividers-ph-712115 returned 404 status code.
2025-11-01 09:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-12-x-12-double-wall-boxes-ph-115245>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-4-mil-vci-poly-sheeting-ph-352191>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-8-x-12-x-350-parcel-ready-air-foam-roll-ph-541207 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-11-x-10-black-stack-hang-bins-ph-711275> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-11-x-10-black-stack-hang-bins-ph-711275 returned 404 status code.
2025-11-01 09:02:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/20-7-8-x-18-1-4-red-stack-nest-lids-ph-717153> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/20-7-8-x-18-1-4-red-stack-nest-lids-ph-717153 returned 404 status code.
2025-11-01 09:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-13-x-39-2-mil-gusseted-poly-bag-ph-318583>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:44 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/20-7-8-x-18-1-4-x-9-7-8-blue-stack-nest-bin-ph-717127> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/20-7-8-x-18-1-4-x-9-7-8-blue-stack-nest-bin-ph-717127 returned 404 status code.
2025-11-01 09:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/20-7-8-x-18-1-4-gray-stack-nest-lids-ph-717155> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/20-7-8-x-18-1-4-gray-stack-nest-lids-ph-717155 returned 404 status code.
2025-11-01 09:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-30--butcher-paper-sheets-ph-512207>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-32-1-mil-flat-poly-bag-ph-312225>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/24-x-350-parcel-ready-perforated-foam-ph-541233 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-36--newsprint-sheets-10-lbs-ph-517121>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:56 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/24-x-31-clear-can-liners-ph-751105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/24-x-31-clear-can-liners-ph-751105 returned 404 status code.
2025-11-01 09:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-do-not-stack-fluorescent-green-labels-ph-411219>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-do-not-top-load-fluorescent-yellow-labels-ph-411259>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-dont-drop-dont-crush-electronic-material-labels-ph-411269>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:01 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-fragile-electronic-equipment-fluor-yellow-labels-ph-411019>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-16-x-24-x-300-adhesive-bubble-rolls-ph-531139>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-16-x-24-x-300-parcel-ready-bubble-rolls-ph-531143 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/3-16-x-48-x-300-parcel-ready-bubble-roll-ph-531155 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 22588 pages (at 358 pages/min), scraped 9614 items (at 165 items/min)
2025-11-01 09:03:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:11 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-white-warehouse-labels-magnetic-strips-ph-416189>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-36-160-do-not-double-stack-edge-protectors-ph-462109>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-3-x-36-160-edge-protectors-skid-lot-ph-462111>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-5-32-black-paper-twist-ties-ph-345135>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-5-fluorescent-pastel-blue-rectangle-laser-labels-ph-414613>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:36 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/5-x-8-2-mil-minigrip-reclosable-poly-bag-ph-313181>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:47 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/60-x-18-wire-shelves-2-pack-ph-715351> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/60-x-18-wire-shelves-2-pack-ph-715351 returned 404 status code.
2025-11-01 09:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/60-x-24-x-86-wire-shelving-add-on-unit-ph-715259> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/60-x-24-x-86-wire-shelving-add-on-unit-ph-715259 returned 404 status code.
2025-11-01 09:03:48 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/60-x-36-x-54-4-shelf-wire-shelving-ph-715261> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/60-x-36-x-54-4-shelf-wire-shelving-ph-715261 returned 404 status code.
2025-11-01 09:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:49 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/60-x-36-wire-shelves-2-pack-ph-715359> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/60-x-36-wire-shelves-2-pack-ph-715359 returned 404 status code.
2025-11-01 09:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-1-8-x-4-1-2-x-3-white-literature-mailer-ph-212367>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/72-x-36-x-54-wire-shelving-add-on-unit-ph-715311>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/72-x-36-x-74-wire-shelving-add-on-unit-ph-715319>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:58 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/72-x-18-wire-shelves-2-pack-ph-715363> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/72-x-18-wire-shelves-2-pack-ph-715363 returned 404 status code.
2025-11-01 09:03:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:03:59 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/72-x-24-x-74-4-shelf-wire-shelving-ph-715301> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/72-x-24-x-74-4-shelf-wire-shelving-ph-715301 returned 404 status code.
2025-11-01 09:03:59 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/72-x-36-x-86-wire-shelving-add-on-unit-ph-715323> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/72-x-36-x-86-wire-shelving-add-on-unit-ph-715323 returned 404 status code.
2025-11-01 09:03:59 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/72-x-36-x-74-4-shelf-wire-shelving-ph-715317> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/72-x-36-x-74-4-shelf-wire-shelving-ph-715317 returned 404 status code.
2025-11-01 09:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:01 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-5-8-x-6-5-8-x-1-1-4-white-easy-fold-mailer-ph-211699>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:01 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/72-x-36-x-54-4-shelf-wire-shelving-ph-715309> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/72-x-36-x-54-4-shelf-wire-shelving-ph-715309 returned 404 status code.
2025-11-01 09:04:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:02 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/72-x-18-x-63-wire-shelving-add-on-unit-ph-715283> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/72-x-18-x-63-wire-shelving-add-on-unit-ph-715283 returned 404 status code.
2025-11-01 09:04:02 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-1-4-x-6-x-5-red-stack-hang-bins-ph-711137> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-1-4-x-6-x-5-red-stack-hang-bins-ph-711137 returned 404 status code.
2025-11-01 09:04:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:03 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-1-4-x-6-x-5-black-stack-hang-bins-ph-711135> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-1-4-x-6-x-5-black-stack-hang-bins-ph-711135 returned 404 status code.
2025-11-01 09:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:05 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-5-8-x-6-5-8-x-3-1-2-kraft-easy-fold-mailer-ph-212125> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-5-8-x-6-5-8-x-3-1-2-kraft-easy-fold-mailer-ph-212125 returned 404 status code.
2025-11-01 09:04:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/no-stack-yellow-pallet-cones-ph-500103>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/nitrile-glove-extended-cuff-xl-ph-891055> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/nitrile-glove-extended-cuff-xl-ph-891055 returned 404 status code.
2025-11-01 09:04:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/plastic-spoons-ph-882002>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/nylon-inspection-glove-mens-xl-ph-891239> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/nylon-inspection-glove-mens-xl-ph-891239 returned 404 status code.
2025-11-01 09:04:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/nitrile-gloves-4-mil-xlarge-ph-891187> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/nitrile-gloves-4-mil-xlarge-ph-891187 returned 404 status code.
2025-11-01 09:04:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 22970 pages (at 382 pages/min), scraped 9791 items (at 177 items/min)
2025-11-01 09:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/nylon-inspection-gloves-mens-large-ph-891237> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/nylon-inspection-gloves-mens-large-ph-891237 returned 404 status code.
2025-11-01 09:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/peltor-optime-98-earmuffs-ph-725119> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/peltor-optime-98-earmuffs-ph-725119 returned 404 status code.
2025-11-01 09:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/office-recycling-container-3-gallon-blue-ph-742133> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/office-recycling-container-3-gallon-blue-ph-742133 returned 404 status code.
2025-11-01 09:04:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/pink-sharpie-accent-highlighters-ph-734171> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/pink-sharpie-accent-highlighters-ph-734171 returned 404 status code.
2025-11-01 09:04:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/pvc-black-dot-knit-gloves-medium-ph-891405> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/pvc-black-dot-knit-gloves-medium-ph-891405 returned 404 status code.
2025-11-01 09:04:10 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/11-1-4-x-8-3-4-x-6-multi-depth-shipper-ph-113157>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/mesh-fingerless-glove-w-wrist-strap-m-ph-891103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/mesh-fingerless-glove-w-wrist-strap-m-ph-891103 returned 404 status code.
2025-11-01 09:04:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/qba-375-quickblade-auto-load-knife-ph-732163> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/qba-375-quickblade-auto-load-knife-ph-732163 returned 404 status code.
2025-11-01 09:04:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/ranger-trash-can-45-gallon-2-way-beige-ph-748105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/ranger-trash-can-45-gallon-2-way-beige-ph-748105 returned 404 status code.
2025-11-01 09:04:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/purple-sharpie-fine-point-markers-ph-734127> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/purple-sharpie-fine-point-markers-ph-734127 returned 404 status code.
2025-11-01 09:04:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/pigskin-leather-drivers-gloves-large-ph-891285> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/pigskin-leather-drivers-gloves-large-ph-891285 returned 404 status code.
2025-11-01 09:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/pvc-blue-dot-knit-gloves-small-ph-891411> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/pvc-blue-dot-knit-gloves-small-ph-891411 returned 404 status code.
2025-11-01 09:04:10 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/red-super-sharpie-markers-ph-734135> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/red-super-sharpie-markers-ph-734135 returned 404 status code.
2025-11-01 09:04:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/red-sharpie-magnum-markers-ph-734147> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/red-sharpie-magnum-markers-ph-734147 returned 404 status code.
2025-11-01 09:04:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/rubbermaid-brute-tandem-dolly-ph-743129> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/rubbermaid-brute-tandem-dolly-ph-743129 returned 404 status code.
2025-11-01 09:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/rubbermaid-recycling-station-92-gallon-ph-742131> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/rubbermaid-recycling-station-92-gallon-ph-742131 returned 404 status code.
2025-11-01 09:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/rsg-197-safety-grip-utility-knife-gray-ph-732113> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/rsg-197-safety-grip-utility-knife-gray-ph-732113 returned 404 status code.
2025-11-01 09:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/rubber-coated-palm-gloves-large-ph-891429> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/rubber-coated-palm-gloves-large-ph-891429 returned 404 status code.
2025-11-01 09:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:13 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/11-1-8-x-8-5-8-x-2-white-deluxe-easy-fold-mailer-ph-211725> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/11-1-8-x-8-5-8-x-2-white-deluxe-easy-fold-mailer-ph-211725 returned 404 status code.
2025-11-01 09:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/red-marsh-88fx-metal-paint-markers-ph-734113> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/red-marsh-88fx-metal-paint-markers-ph-734113 returned 404 status code.
2025-11-01 09:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-4-x-18-x-250-anti-static-foam-rolls-ph-541279>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:28 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:31 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:33 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-13-x-12-red-space-age-totes-ph-716111> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-13-x-12-red-space-age-totes-ph-716111 returned 404 status code.
2025-11-01 09:04:33 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-13-x-6-blue-space-age-totes-ph-716103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-13-x-6-blue-space-age-totes-ph-716103 returned 404 status code.
2025-11-01 09:04:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-18--50-lb-kraft-paper-sheets-ph-511229>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-18-air-foam-sheets-ph-543113>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:33 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-13-x-6-red-space-age-totes-ph-716105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-13-x-6-red-space-age-totes-ph-716105 returned 404 status code.
2025-11-01 09:04:33 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-13-x-12-white-space-age-totes-ph-716107> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-13-x-12-white-space-age-totes-ph-716107 returned 404 status code.
2025-11-01 09:04:33 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-14-x-12-20-pack-corrugated-box-ph-103703> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-14-x-12-20-pack-corrugated-box-ph-103703 returned 404 status code.
2025-11-01 09:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:34 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-16-1-2-x-11-black-stack-hang-bin-ph-711289> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-16-1-2-x-11-black-stack-hang-bin-ph-711289 returned 404 status code.
2025-11-01 09:04:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-18-x-20-corrugated-boxes-ph-101969>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:37 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/18-x-16-1-2-x-11-blue-stack-hang-bins-ph-711283> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/18-x-16-1-2-x-11-blue-stack-hang-bins-ph-711283 returned 404 status code.
2025-11-01 09:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:38 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 09:04:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-20-4-mil-anti-static-reclosable-poly-bag-ph-331233>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-20-x-36-tall-corrugated-boxes-ph-102153>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-24-6-mil-anti-static-flat-poly-bag-ph-331361>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-24-6-mil-flat-poly-bag-ph-312306>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/24-x-75ga-reynolon-5044-pvc-shrink-film-ph-383173>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:48 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 09:04:48 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-5-8-x-1-fluor-green-removable-rectangle-laser-labels-ph-414281>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:51 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/26-5-8-x-18-1-4-x-14-7-8-blue-stack-nest-bin-ph-717133> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/26-5-8-x-18-1-4-x-14-7-8-blue-stack-nest-bin-ph-717133 returned 404 status code.
2025-11-01 09:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:53 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/26-5-8-x-18-1-4-gray-stack-nest-lids-ph-717161> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/26-5-8-x-18-1-4-gray-stack-nest-lids-ph-717161 returned 404 status code.
2025-11-01 09:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-magnetic-c-channel-cardholders-ph-416013>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-oct-fluorescent-orange-months-of-the-year-labels-ph-412385>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:54 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-3-partial-case-fluorescent-green-labels-ph-411317>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:55 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-3-green-superior-vinyl-carpet-mat-ph-737480> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-3-green-superior-vinyl-carpet-mat-ph-737480 returned 404 status code.
2025-11-01 09:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:55 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/26-x-19-x-15-5-8-gray-round-trip-tote-ph-717107> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/26-x-19-x-15-5-8-gray-round-trip-tote-ph-717107 returned 404 status code.
2025-11-01 09:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:01 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-3-walnut-marble-anti-fatigue-mat-ph-737108> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-3-walnut-marble-anti-fatigue-mat-ph-737108 returned 404 status code.
2025-11-01 09:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:03 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-3-4-x-1-7-8-yellow-tyvek-pre-wired-shipping-tag-ph-424071>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-dots-clear-velcro-tape-combo-pack-ph-673029>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-purple-inventory-circle-labels-ph-412137>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:06 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/33-x-39-clear-can-liners-ph-751117> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/33-x-39-clear-can-liners-ph-751117 returned 404 status code.
2025-11-01 09:05:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:07 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/33-x-40-black-can-liners-ph-751157> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/33-x-40-black-can-liners-ph-751157 returned 404 status code.
2025-11-01 09:05:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 23359 pages (at 389 pages/min), scraped 9954 items (at 163 items/min)
2025-11-01 09:05:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-10-day-glo-blue-plastic-wristbands-ph-431001>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:12 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-72-yds-3m-665-double-sided-film-tape-ph-653033>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:14 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:16 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:05:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-x-12-wire-shelf-ph-715325>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:17 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/masking-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:18 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-12-1-2-x-66-floor-rack-bin-organizer-ph-714109> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-12-1-2-x-66-floor-rack-bin-organizer-ph-714109 returned 404 status code.
2025-11-01 09:05:18 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/strapping-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-4-fluorescent-red-inventory-rectangle-labels-ph-412435>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/industrial-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:20 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-12-x-54-4-shelf-wire-shelving-ph-715101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-12-x-54-4-shelf-wire-shelving-ph-715101 returned 404 status code.
2025-11-01 09:05:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:21 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/strapping-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:05:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:22 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:05:22 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-4-medium-gray-waterhog-mat-ph-737182> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-4-medium-gray-waterhog-mat-ph-737182 returned 404 status code.
2025-11-01 09:05:22 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-2-mil-red-reclosable-poly-bag-ph-315091>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:24 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:25 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:26 [py.warnings] (PID: 95) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2025-11-01 09:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:27 [scrapy.extensions.feedexport] (PID: 95) INFO: Stored bq feed (1000 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:10
2025-11-01 09:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:30 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:33 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-fluorescent-yellow-inventory-rectangle-labels-ph-412775>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:34 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-6-burgundy-deluxe-entry-mat-ph-737456> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-6-burgundy-deluxe-entry-mat-ph-737456 returned 404 status code.
2025-11-01 09:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-6-fragile-handle-with-care-labels-ph-411651>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:40 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-6-green-waterhog-mat-ph-737235> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-6-green-waterhog-mat-ph-737235 returned 404 status code.
2025-11-01 09:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:40 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-6-gray-marble-anti-fatigue-mat-ph-737147> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-6-gray-marble-anti-fatigue-mat-ph-737147 returned 404 status code.
2025-11-01 09:05:40 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/4-x-6-job-ticket-holders-ph-731101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/4-x-6-job-ticket-holders-ph-731101 returned 404 status code.
2025-11-01 09:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:42 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:43 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-1-4-x-3-1-8-10-pt-manila-shipping-tags-pre-wired-ph-422087>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-blue-stack-hang-bin-ph-711115>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-green-stack-hang-bin-ph-711119>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:54 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-black-conductive-bins-ph-711419> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-black-conductive-bins-ph-711419 returned 404 status code.
2025-11-01 09:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:54 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-red-stack-hang-bins-ph-711123> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-red-stack-hang-bins-ph-711123 returned 404 status code.
2025-11-01 09:05:54 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/74-chrome-poles-2-pack-ph-715381> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/74-chrome-poles-2-pack-ph-715381 returned 404 status code.
2025-11-01 09:05:55 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-x-16-3-mil-flat-poly-bag-ph-311588>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-x-20-4-mil-flat-poly-bag-ph-311549>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:05:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:00 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/7-x-3-plastic-shelf-bin-dividers-ph-712129> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/7-x-3-plastic-shelf-bin-dividers-ph-712129 returned 404 status code.
2025-11-01 09:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-12-job-ticket-holders-ph-731109>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:05 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:06 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-12-x-4-1-2-stackable-bin-boxes-ph-173119>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-x-12-neon-yellow-job-ticket-holders-ph-731131> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-x-12-neon-yellow-job-ticket-holders-ph-731131 returned 404 status code.
2025-11-01 09:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 23750 pages (at 391 pages/min), scraped 10117 items (at 163 items/min)
2025-11-01 09:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/9-x-14-6-mil-flat-poly-bag-ph-311739>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:09 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/9-x-12-heavyweight-job-ticket-holders-ph-731155> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/9-x-12-heavyweight-job-ticket-holders-ph-731155 returned 404 status code.
2025-11-01 09:06:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/scott-blue-shop-towels-pop-up-box-ph-845007> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/scott-blue-shop-towels-pop-up-box-ph-845007 returned 404 status code.
2025-11-01 09:06:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/scott-coreless-toliet-tissue-dispenser-ph-821039> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/scott-coreless-toliet-tissue-dispenser-ph-821039 returned 404 status code.
2025-11-01 09:06:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/scott-2-ply-coreless-toliet-tissue-ph-821025> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/scott-2-ply-coreless-toliet-tissue-ph-821025 returned 404 status code.
2025-11-01 09:06:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/scott-rags-in-a-box-ph-845001> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/scott-rags-in-a-box-ph-845001 returned 404 status code.
2025-11-01 09:06:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-black-20-30-gal-ph-755105> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-black-20-30-gal-ph-755105 returned 404 status code.
2025-11-01 09:06:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-black-33-gal-ph-755109> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-black-33-gal-ph-755109 returned 404 status code.
2025-11-01 09:06:13 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-black-55-60-gal-ph-755127> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-black-55-60-gal-ph-755127 returned 404 status code.
2025-11-01 09:06:13 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-black-44-55-gal-ph-755121> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-black-44-55-gal-ph-755121 returned 404 status code.
2025-11-01 09:06:13 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/scott-coreless-toliet-tissue-dispenser-ph-821041> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/scott-coreless-toliet-tissue-dispenser-ph-821041 returned 404 status code.
2025-11-01 09:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-clear-6-bushel-ph-755159> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-clear-6-bushel-ph-755159 returned 404 status code.
2025-11-01 09:06:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/sharpie-metallic-marker-silver-ph-734157> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/sharpie-metallic-marker-silver-ph-734157 returned 404 status code.
2025-11-01 09:06:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-clear-40-45-gal-ph-755155> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-clear-40-45-gal-ph-755155 returned 404 status code.
2025-11-01 09:06:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/slim-jim-bottle-and-can-recycling-lid-green-ph-742103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/slim-jim-bottle-and-can-recycling-lid-green-ph-742103 returned 404 status code.
2025-11-01 09:06:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/slim-jim-swing-top-lid-23-gallon-beige-ph-742173> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/slim-jim-swing-top-lid-23-gallon-beige-ph-742173 returned 404 status code.
2025-11-01 09:06:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/slim-jim-trash-can-23-gallon-beige-ph-742165> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/slim-jim-trash-can-23-gallon-beige-ph-742165 returned 404 status code.
2025-11-01 09:06:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-clear-60-gal-ph-755165> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-clear-60-gal-ph-755165 returned 404 status code.
2025-11-01 09:06:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/slim-jim-swing-top-lid-23-gallon-gray-ph-742179> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/slim-jim-swing-top-lid-23-gallon-gray-ph-742179 returned 404 status code.
2025-11-01 09:06:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/the-moving-box-combo-pack-ph-192105>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/sp-017-single-notch-safety-blades-ph-732181> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/sp-017-single-notch-safety-blades-ph-732181 returned 404 status code.
2025-11-01 09:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/stainless-steel-wall-mount-sanitary-receptacle-ph-825003> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/stainless-steel-wall-mount-sanitary-receptacle-ph-825003 returned 404 status code.
2025-11-01 09:06:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-black-56-gal-ph-755129> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-black-56-gal-ph-755129 returned 404 status code.
2025-11-01 09:06:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1-2-x-26-kraft-tubes-with-caps-ph-213133>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-1-2-x-2-rush-bill-of-lading-flame-labels-ph-411051>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/stairs-ada-compliant-plastic-sign-ph-781103> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/stairs-ada-compliant-plastic-sign-ph-781103 returned 404 status code.
2025-11-01 09:06:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/smoking-area-6-x-9-facility-sign-ph-781139> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/smoking-area-6-x-9-facility-sign-ph-781139 returned 404 status code.
2025-11-01 09:06:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/spd-017-safety-point-blade-dispenser-ph-732201> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/spd-017-safety-point-blade-dispenser-ph-732201 returned 404 status code.
2025-11-01 09:06:15 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:16 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/string-knit-cotton-gloves-small-ph-891419> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/string-knit-cotton-gloves-small-ph-891419 returned 404 status code.
2025-11-01 09:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:16 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/second-chance-trash-bag-clear-15-gal-ph-755147> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/second-chance-trash-bag-clear-15-gal-ph-755147 returned 404 status code.
2025-11-01 09:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:17 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/square-recycling-bottle-and-can-lid-blue-ph-742143> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/square-recycling-bottle-and-can-lid-blue-ph-742143 returned 404 status code.
2025-11-01 09:06:17 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/square-recycling-container-23-gal-blue-ph-742139> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/square-recycling-container-23-gal-blue-ph-742139 returned 404 status code.
2025-11-01 09:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-electrical-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:18 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/terry-cloth-towels-white-25-lb-box-ph-827041> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/terry-cloth-towels-white-25-lb-box-ph-827041 returned 404 status code.
2025-11-01 09:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:18 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-1-2-x-60-yds-3m-201+-masking-tape-ph-681611> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-1-2-x-60-yds-3m-201+-masking-tape-ph-681611 returned 404 status code.
2025-11-01 09:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:18 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-1-2-x-60-yds-3m-301+-masking-tape-ph-681661> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-1-2-x-60-yds-3m-301+-masking-tape-ph-681661 returned 404 status code.
2025-11-01 09:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:19 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-1-2-x-60-yds-3m-401+-233+-masking-tape-ph-681663> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-1-2-x-60-yds-3m-401+-233+-masking-tape-ph-681663 returned 404 status code.
2025-11-01 09:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:19 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/toilet-seat-cover-dispenser-chrome-ph-824009> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/toilet-seat-cover-dispenser-chrome-ph-824009 returned 404 status code.
2025-11-01 09:06:19 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-24-6-mil-anti-static-flat-poly-bag-ph-331343>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:19 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/1-1-2-x-60-yds-3m-501+-masking-tape-ph-681665> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/1-1-2-x-60-yds-3m-501+-masking-tape-ph-681665 returned 404 status code.
2025-11-01 09:06:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:21 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-30-6-mil-flat-poly-bag-ph-312091>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/1-2-x-24-x-125-parcel-ready-bubble-rolls-ph-531225 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:23 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:26 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-double-sided-film-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:27 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/double-sided-foam-tape-roll already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/12-x-3-x-3-long-corrugated-boxes-ph-101283>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/1-4-x-36-yds-blue-3-pack-3m-471-vinyl-tape-ph-631017>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/vinyl-safety-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/14-x-8-x-4-flat-corrugated-boxes-ph-101553>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/18-x-18-x-6-double-wall-boxes-ph-115275>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:40 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:42 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:45 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:06:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:46 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/20-x-70ga-x-extended-core-cast-stretch-film-ph-361103>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/product-cushioning already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:50 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-1-2-x-12-4-mil-reclosable-poly-bag-ph-315288>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:50 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/product-cushioning> (failed 3 times): Invalid response, retrying...
2025-11-01 09:06:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:52 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:53 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:56 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/honeycomb-pallet-runners already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:57 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:58 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/27-x-4-x-4-pallet-runner-ph-486003 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/48-x-6-x-4-honeycomb-pallet-runners-ph-486001 already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:00 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/honeycomb-pallet-runners already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-55-yds-approved-printed-box-tape-ph-617087>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:04 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/2-x-55-yds-black-3m-gt2-gaffers-tape-ph-693057>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/carton-sealing-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 24174 pages (at 424 pages/min), scraped 10284 items (at 167 items/min)
2025-11-01 09:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:08 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/2-x-55-yds-fragile-box-printed-box-tape-ph-617099> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/2-x-55-yds-fragile-box-printed-box-tape-ph-617099 returned 404 status code.
2025-11-01 09:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:09 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-10-pink-checkerboard-tyvek-wristbands-ph-431065>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/duct-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:10 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:10 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:11 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:13 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/duct-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/34-x-21-x-6-flat-corrugated-boxes-ph-102817>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-4-x-3-4-black-cable-tie-mounts-ph-449003>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/carton-sealing-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:13 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:07:14 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:07:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:16 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/hook-and-loop-tape>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/industrial-adhesive-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:17 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:17 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-12-x-74-wire-shelving-add-on-unit-ph-715121> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-12-x-74-wire-shelving-add-on-unit-ph-715121 returned 404 status code.
2025-11-01 09:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:18 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-18-wire-shelf-ph-715329> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-18-wire-shelf-ph-715329 returned 404 status code.
2025-11-01 09:07:18 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-18-x-63-wire-shelving-add-on-unit-ph-715145> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-18-x-63-wire-shelving-add-on-unit-ph-715145 returned 404 status code.
2025-11-01 09:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:18 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-18-x-74-4-shelf-wire-shelving-ph-715149> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-18-x-74-4-shelf-wire-shelving-ph-715149 returned 404 status code.
2025-11-01 09:07:18 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/36-x-27-x-65-1-mil-clear-pallet-covers-ph-351109>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/hook-and-loop-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:19 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-18-x-86-wire-shelving-add-on-unit-ph-715161> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-18-x-86-wire-shelving-add-on-unit-ph-715161 returned 404 status code.
2025-11-01 09:07:19 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:20 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-24-x-12-corrugated-boxes-ph-103605> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-24-x-12-corrugated-boxes-ph-103605 returned 404 status code.
2025-11-01 09:07:20 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/masking-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:22 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-24-x-74-wire-shelving-add-on-unit-ph-715175> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-24-x-74-wire-shelving-add-on-unit-ph-715175 returned 404 status code.
2025-11-01 09:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:22 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/hook-and-loop-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:22 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-24-x-86-4-shelf-wire-shelving-ph-715177> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-24-x-86-4-shelf-wire-shelving-ph-715177 returned 404 status code.
2025-11-01 09:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:24 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-55-yds-clear-sm-pk-3m-373-box-tape-ph-613221>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:24 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/36-x-12-x-74-4-shelf-wire-shelving-ph-715117> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/36-x-12-x-74-4-shelf-wire-shelving-ph-715117 returned 404 status code.
2025-11-01 09:07:24 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/masking-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:29 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:29 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-5-charcoal-economy-vinyl-carpet-mat-ph-737515> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-5-charcoal-economy-vinyl-carpet-mat-ph-737515 returned 404 status code.
2025-11-01 09:07:29 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/3-x-5-charcoal-deluxe-entry-mat-ph-737452> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/3-x-5-charcoal-deluxe-entry-mat-ph-737452 returned 404 status code.
2025-11-01 09:07:30 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-do-not-bend-fluorescent-red-labels-ph-411329>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:32 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/3-x-5-do-not-inventory-date-fluorescent-red-labels-ph-411391>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:34 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/46-x-84-11-mil-mattress-bags-ph-323141>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:35 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:07:35 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:35 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/carton-sealing-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/48-x-12-x-12-double-wall-boxes-ph-115517>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:37 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:07:37 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/48-x-16-x-16-long-corrugated-boxes-ph-103001>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:37 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:07:38 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/48-x-18-x-74-wire-shelving-add-on-unit-ph-715207>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/48-x-24-x-12-double-wall-boxes-ph-115521>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:39 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/48-x-24-x-28-double-wall-gaylord-bottom-ph-131149>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:39 [scrapy.downloadermiddlewares.retry] (PID: 95) ERROR: Gave up retrying <GET https://www.packaginghero.com/carton-sealing-tape> (failed 3 times): Invalid response, retrying...
2025-11-01 09:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:41 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-12-wire-shelf-ph-715337> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-12-wire-shelf-ph-715337 returned 404 status code.
2025-11-01 09:07:41 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-12-x-86-4-shelf-wire-shelving-ph-715193> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-12-x-86-4-shelf-wire-shelving-ph-715193 returned 404 status code.
2025-11-01 09:07:41 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/48-x-24-x-74-wire-shelving-add-on-unit-ph-715223>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:41 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-18-x-54-wire-shelving-add-on-unit-ph-715199> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-18-x-54-wire-shelving-add-on-unit-ph-715199 returned 404 status code.
2025-11-01 09:07:41 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:41 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-18-x-86-wire-shelving-add-on-unit-ph-715211> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-18-x-86-wire-shelving-add-on-unit-ph-715211 returned 404 status code.
2025-11-01 09:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:43 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-24-x-63-4-shelf-wire-shelving-ph-715217> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-24-x-63-4-shelf-wire-shelving-ph-715217 returned 404 status code.
2025-11-01 09:07:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:43 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:44 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/4-x-8-6-mil-reclosable-poly-bag-ph-315177>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/wholesale-label-protection-tape already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:45 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:45 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/48-x-24-x-54-wire-shelving-add-on-unit-ph-715215> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/48-x-24-x-54-wire-shelving-add-on-unit-ph-715215 returned 404 status code.
2025-11-01 09:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:47 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:49 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-1-4-x-3-1-8-4000-4499-tag-carbonless-stub-style-wired-ph-425199>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:50 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:51 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/6-1-4-x-3-1-8-9000-9499-tags-3-part-carbonless-8-ph-425317>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:02 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:08:02 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:03 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:05 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/7-x-8-2-mil-flat-poly-bag-ph-311532>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:08:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:05 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:06 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:07 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:08 [scrapy.extensions.logstats] (PID: 95) INFO: Crawled 24553 pages (at 379 pages/min), scraped 10441 items (at 157 items/min)
2025-11-01 09:08:08 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/toilet-seat-cover-dispenser-smoke-ph-824005> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/toilet-seat-cover-dispenser-smoke-ph-824005 returned 404 status code.
2025-11-01 09:08:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/toilet-seat-covers-ph-824003> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/toilet-seat-covers-ph-824003 returned 404 status code.
2025-11-01 09:08:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/ukh-325-2-pocket-nylon-holster-ph-732145> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/ukh-325-2-pocket-nylon-holster-ph-732145 returned 404 status code.
2025-11-01 09:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:11 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/vinyl-gloves-3-mil-powdered-s-ph-891347> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/vinyl-gloves-3-mil-powdered-s-ph-891347 returned 404 status code.
2025-11-01 09:08:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/vinyl-gloves-3-mil-powder-free-l-ph-891359> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/vinyl-gloves-3-mil-powder-free-l-ph-891359 returned 404 status code.
2025-11-01 09:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:12 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-s-ph-891387> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-s-ph-891387 returned 404 status code.
2025-11-01 09:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:13 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-xl-ph-891377> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-xl-ph-891377 returned 404 status code.
2025-11-01 09:08:13 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/virtua-ap-clear-protective-eyewear-ph-722107> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/virtua-ap-clear-protective-eyewear-ph-722107 returned 404 status code.
2025-11-01 09:08:13 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <GET https://www.packaginghero.com/yellow-sharpie-accent-highlighters-ph-734173>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:08:14 [scrapy.core.scraper] (PID: 95) ERROR: Error downloading <POST https://www.packaginghero.com/Product/GetPriceWithInventory>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2017, in _inlineCallbacks
    result = context.run(gen.send, result)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 57, in process_request
    method(request=request, spider=spider)
  File "/usr/local/lib/python3.11/site-packages/scraping_utils/middlewares/downloaders/spoofer.py", line 101, in process_request
    generated_headers = self.generator.generate()
                        ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 159, in generate
    generated: Dict[str, str] = self._get_headers(
                                ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 267, in _get_headers
    return self.order_headers({**generated_sample, **request_dependent_headers})
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/browserforge/headers/generator.py", line 357, in order_headers
    raise ValueError("Failed to find User-Agent in generated response")
ValueError: Failed to find User-Agent in generated response
2025-11-01 09:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:14 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wheelchair-accessible-ada-compliant-plastic-sign-ph-781101> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wheelchair-accessible-ada-compliant-plastic-sign-ph-781101 returned 404 status code.
2025-11-01 09:08:15 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wypall-x70-91-x-168-pro-wipers-ph-843041> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wypall-x70-91-x-168-pro-wipers-ph-843041 returned 404 status code.
2025-11-01 09:08:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wypall-x70-pro-jumbo-roll-wipers-ph-843045> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wypall-x70-pro-jumbo-roll-wipers-ph-843045 returned 404 status code.
2025-11-01 09:08:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wypall-waterless-cleaning-wipes-ph-843005> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wypall-waterless-cleaning-wipes-ph-843005 returned 404 status code.
2025-11-01 09:08:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wypall-l30-economy-164-x-98-wipers-dispenser-ph-843013> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wypall-l30-economy-164-x-98-wipers-dispenser-ph-843013 returned 404 status code.
2025-11-01 09:08:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wypall-x80-91-x-168-heavy-duty-wipers-ph-843053> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wypall-x80-91-x-168-heavy-duty-wipers-ph-843053 returned 404 status code.
2025-11-01 09:08:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wypall-x90-heavy-duty-jumbo-roll-wipers-ph-843069> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wypall-x90-heavy-duty-jumbo-roll-wipers-ph-843069 returned 404 status code.
2025-11-01 09:08:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/wypall-x70-pro-wipers-bulk-pack-ph-843039> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/wypall-x70-pro-wipers-bulk-pack-ph-843039 returned 404 status code.
2025-11-01 09:08:15 [scrapy.core.scraper] (PID: 95) ERROR: Spider error processing <GET https://www.packaginghero.com/yellow-mean-streak-paint-in-a-tube-ph-734163> (referer: None)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 83, in _process_spider_input
    result = method(response=response, spider=spider)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/middlewares.py", line 234, in process_spider_input
    raise ProductNotFound(f"Page {response.url} returned 404 status code.")
scraping_utils.common.exceptions.ProductNotFound: Page https://www.packaginghero.com/yellow-mean-streak-paint-in-a-tube-ph-734163 returned 404 status code.
2025-11-01 09:08:18 [HeadersSpooferDownloaderMiddleware] (PID: 95) WARNING: Request https://www.packaginghero.com/Product/GetPriceWithInventory already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2025-11-01 09:08:18 [scrapy.core.engine] (PID: 95) INFO: Closing spider (finished)
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] ------------------------------ MONITORS ------------------------------
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] Extracted Items Monitor/test_stat_monitor... FAIL
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] Item Validation Monitor/test_stat_monitor... SKIPPED (Unable to find 'spidermon/validation/fields/errors' in job stats.)
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] Error Count Monitor/test_stat_monitor... FAIL
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] Warning Count Monitor/test_stat_monitor... FAIL
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] Finish Reason Monitor/Should have the expected finished reason(s)... OK
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] Unwanted HTTP codes monitor/Should not hit the limit of unwanted http status... OK
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] Field Coverage Monitor/test_check_if_field_coverage_rules_are_met... OK
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] Retry Count monitor/Should not hit the limit of requests that reached the maximum retry amount... FAIL
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] Downloader Exceptions monitor/test_stat_monitor... FAIL
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] Successful Requests monitor/Should have at least the minimum number of successful requests... OK
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] Total Requests monitor/Should not hit the total limit of requests... OK
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] ----------------------------------------------------------------------
2025-11-01 09:08:18 [packaging_hero] (PID: 95) ERROR: [Spidermon] 
======================================================================
FAIL: Extracted Items Monitor/test_stat_monitor
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor
    assertion_method(
AssertionError: Expecting 'item_scraped_count' to be '>=' to '12500.0'. Current value: '10467'

2025-11-01 09:08:18 [packaging_hero] (PID: 95) ERROR: [Spidermon] 
======================================================================
FAIL: Error Count Monitor/test_stat_monitor
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor
    assertion_method(
AssertionError: Expecting 'log_count/ERROR' to be '<=' to '1201.0'. Current value: '4207'

2025-11-01 09:08:18 [packaging_hero] (PID: 95) ERROR: [Spidermon] 
======================================================================
FAIL: Warning Count Monitor/test_stat_monitor
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor
    assertion_method(
AssertionError: Expecting 'log_count/WARNING' to be '<=' to '2.0'. Current value: '13106'

2025-11-01 09:08:18 [packaging_hero] (PID: 95) ERROR: [Spidermon] 
======================================================================
FAIL: Retry Count monitor/Should not hit the limit of requests that reached the maximum retry amount
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/monitors.py", line 282, in test_maximum_retries
    self.assertLessEqual(max_reached, threshold, msg=msg)
AssertionError: Too many requests (728) reached the maximum retry amount

2025-11-01 09:08:18 [packaging_hero] (PID: 95) ERROR: [Spidermon] 
======================================================================
FAIL: Downloader Exceptions monitor/test_stat_monitor
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor
    assertion_method(
AssertionError: Expecting 'downloader/exception_count' to be '<=' to '100.0'. Current value: '2962'

2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] 11 monitors in 0.007s
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] FAILED (failures=5, skipped=1)
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] -------------------------- FINISHED ACTIONS --------------------------
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] ----------------------------------------------------------------------
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] 0 actions in 0.000s
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] OK
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] --------------------------- PASSED ACTIONS ---------------------------
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] ----------------------------------------------------------------------
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] 0 actions in 0.000s
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] OK
2025-11-01 09:08:18 [packaging_hero] (PID: 95) INFO: [Spidermon] --------------------------- FAILED ACTIONS ---------------------------
2025-11-01 09:08:19 [spidermon.contrib.actions.slack] (PID: 95) WARNING: bot cannot finder user in slack org member list - default icon url used
2025-11-01 09:08:19 [packaging_hero] (PID: 95) INFO: [Spidermon] CustomTemplateSendSlackMessageSpiderFinished... OK
2025-11-01 09:08:19 [packaging_hero] (PID: 95) INFO: [Spidermon] ----------------------------------------------------------------------
2025-11-01 09:08:19 [packaging_hero] (PID: 95) INFO: [Spidermon] 1 action in 0.444s
2025-11-01 09:08:19 [packaging_hero] (PID: 95) INFO: [Spidermon] OK
2025-11-01 09:08:19 [packaging_hero] (PID: 95) INFO: 1133 URLs returned ProductNotFound.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-1-2-x-60-yds-3m-101+-masking-tape-ph-681635 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-1-2-x-60-yds-3m-101+-masking-tape-ph-681639 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-1-2-x-60-yds-3m-201+-masking-tape-ph-681611 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-1-2-x-60-yds-3m-201+-masking-tape-ph-681641 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-1-2-x-60-yds-3m-301+-masking-tape-ph-681631 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-1-2-x-60-yds-3m-301+-masking-tape-ph-681661 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-1-2-x-60-yds-3m-401+-233+-masking-tape-ph-681663 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-1-2-x-60-yds-3m-501+-masking-tape-ph-681633 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-1-2-x-60-yds-3m-501+-masking-tape-ph-681665 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-1-2-x-60-yds-8-pack-3m-401+-233+-masking-tape-ph-681637 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-2-cubic-yard-domed-tilt-truck-lid-ph-749103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-2-x-120-yds-3m-860-poly-strapping-tape-ph-643005 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-2-x-60-yds-3m-860-poly-strapping-tape-ph-643013 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-4-x-14-trash-can-bands-ph-759103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-4-x-17-trash-can-bands-ph-759105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-x-60-yds-13m-101+-masking-tape-ph-681471 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-x-60-yds-13m-201+-masking-tape-ph-681475 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-x-60-yds-13m-301+-masking-tape-ph-681541 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-x-60-yds-13m-501+-masking-tape-ph-681545 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-x-60-yds-3m-101+-masking-tape-ph-681557 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-x-60-yds-3m-301+-masking-tape-ph-681605 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-x-60-yds-3m-401+-233+-masking-tape-ph-681543 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-x-60-yds-3m-401+-233+-masking-tape-ph-681607 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-x-60-yds-3m-501+-masking-tape-ph-681609 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-x-60-yds-3m-9485.c-adhesive-transfer-tape-ph-651035 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1-x-60-yds-3m-9485.c-adhesive-transfer-tape-ph-651061 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/1.57-x-1181-black-datamax-thermal-transfer-ribbons-wax-ph-415103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-1-2-x-16-kraft-5-padded-mailers-ph-251155 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-1-8-x-3-3-4-stack-hang-dividers-ph-712111 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-1-8-x-4-3-4-stack-hang-dividers-ph-712109 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-black-stack-hang-bin-ph-711149 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-blue-stack-hang-bin-ph-711143 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-green-stack-hang-bin-ph-711147 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-ivory-stack-hang-bin-ph-711153 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-red-stack-hang-bin-ph-711151 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-yellow-stack-hang-bin-ph-711155 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-7-8-x-11-x-5-black-stack-hang-bins-ph-711191 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-7-8-x-11-x-5-blue-stack-hang-bins-ph-711185 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-7-8-x-11-x-5-green-stack-hang-bins-ph-711189 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-7-8-x-11-x-5-ivory-stack-hang-bins-ph-711195 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-7-8-x-11-x-5-red-stack-hang-bins-ph-711193 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-7-8-x-11-x-5-yellow-stack-hang-bin-ph-711197 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-black-stack-hang-bin-ph-711163 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-blue-stack-hang-bin-ph-711157 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-clear-stack-hang-bin-ph-711159 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-green-stack-hang-bin-ph-711161 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-ivory-stack-hang-bin-ph-711167 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-red-stack-hang-bin-ph-711165 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-yellow-stack-hang-bin-ph-711169 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-black-conductive-bin-ph-711421 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-blue-stack-hang-bin-ph-711171 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-clear-stack-hang-bin-ph-711173 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-green-stack-hang-bin-ph-711175 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-ivory-stack-hang-bin-ph-711181 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-yellow-stack-hang-bin-ph-711183 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/10-x-30-4-mil-reclosable-poly-bag-ph-315447 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/100-jersey-cotton-gloves-large-ph-891425 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/100-jersey-cotton-gloves-small-ph-891423 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-11-1-8-x-4-blue-shelf-bins-ph-711335 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-11-1-8-x-4-green-shelf-bins-ph-711337 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-11-1-8-x-4-red-shelf-bins-ph-711339 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-11-1-8-x-4-yellow-shelf-bins-ph-711341 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-2-3-4-x-4-blue-shelf-bins-ph-711297 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-2-3-4-x-4-green-shelf-bins-ph-711299 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-2-3-4-x-4-red-shelf-bins-ph-711301 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-2-3-4-x-4-yellow-shelf-bins-ph-711303 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-4-1-8-x-4-blue-shelf-bins-ph-711305 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-4-1-8-x-4-clear-shelf-bins-ph-711313 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-4-1-8-x-4-green-shelf-bins-ph-711307 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-4-1-8-x-4-red-shelf-bins-ph-711309 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-4-1-8-x-4-yellow-shelf-bins-ph-711311 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-6-5-8-x-4-blue-shelf-bins-ph-711315 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-6-5-8-x-4-clear-shelf-bins-ph-711317 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-6-5-8-x-4-green-shelf-bins-ph-711319 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-6-5-8-x-4-red-shelf-bins-ph-711321 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-6-5-8-x-4-yellow-shelf-bins-ph-711323 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-8-3-8-x-4-blue-shelf-bins-ph-711325 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-8-3-8-x-4-clear-shelf-bins-ph-711327 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-8-3-8-x-4-green-shelf-bins-ph-711329 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-8-3-8-x-4-red-shelf-bins-ph-711331 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-5-8-x-8-3-8-x-4-yellow-shelf-bins-ph-711333 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-x-14-job-ticket-holders-ph-731111 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-x-14-solid-back-job-ticket-holders-ph-731135 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-x-17-job-ticket-holders-ph-731113 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/11-x-8-1-2-job-ticket-holders-ph-731133 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/12-1-8-x-11-5-8-x-2-5-8-side-loading-mailer-ph-212705 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/12-1-8-x-9-1-4-x-5-kraft-deluxe-literature-mailer-ph-212213 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/12-1-8-x-9-x-2-1-2-side-loading-mailer-ph-212703 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/12-wide-seal-foot-operated-impulse-sealer-ph-344127 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/12-x-10-3-mil-flat-poly-bag-ph-311965 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/12-x-13-4-mil-reclosable-poly-bag-ph-315494 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/12-x-15-1-2-poly-mailers-without-tear-strip-ph-221215 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/12-x-15-job-ticket-holders-ph-731115 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/12-x-20-6-mil-reclosable-poly-bag-ph-315498 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/12-x-8-x-20-3-mil-gusseted-poly-bag-ph-318411 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/13-15-16-x-4-3-4-stack-hang-dividers-ph-712113 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/13-7-8-x-6-3-4-stack-hang-dividers-ph-712117 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/13-pt-steel-track-snap-utility-knife-ph-732131 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/13-pt-steel-track-utility-knife-w-grip-ph-732127 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/13-x-16-3-mil-flat-poly-bag-ph-311957 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-black-stack-hang-bin-ph-711233 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-blue-stack-hang-bin-ph-711227 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-clear-stack-hang-bin-ph-711229 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-green-stack-hang-bin-ph-711231 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-ivory-stack-hang-bin-ph-711237 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-red-stack-hang-bin-ph-711235 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-yellow-stack-hang-bin-ph-711239 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-black-stack-hang-bin-ph-711205 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-blue-stack-hang-bin-ph-711199 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-clear-stack-hang-bin-ph-711201 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-ivory-stack-hang-bin-ph-711209 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-yellow-stack-hang-bin-ph-711211 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-black-conductive-bin-ph-711423 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-black-stack-hang-bin-ph-711219 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-clear-stack-hang-bin-ph-711215 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-green-stack-hang-bin-ph-711217 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-ivory-stack-hang-bin-ph-711223 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-red-stack-hang-bin-ph-711221 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-yellow-stack-hang-bin-ph-711225 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/15-3-4-x-7-3-4-stack-hang-dividers-ph-712119 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/15-x-11-1-8-x-6-kraft-easy-fold-mailers-ph-211799 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/16-x-10-blue-stack-nest-lids-ph-717139 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/16-x-10-gray-stack-nest-lids-ph-717143 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/16-x-10-red-stack-nest-lids-ph-717141 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/16-x-10-x-8-7-8-blue-stack-nest-bin-ph-717109 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/16-x-10-x-8-7-8-gray-stack-nest-bin-ph-717113 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/16-x-10-x-8-7-8-red-stack-nest-bin-ph-717111 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/16-x-11-x-8-black-stack-hang-bins-ph-711247 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/16-x-11-x-8-blue-stack-hang-bins-ph-711241 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/16-x-11-x-8-clear-stack-hang-bins-ph-711243 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/16-x-11-x-8-green-stack-hang-bins-ph-711245 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/16-x-11-x-8-ivory-stack-hang-bins-ph-711251 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/16-x-11-x-8-red-stack-hang-bins-ph-711249 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/16-x-11-x-8-yellow-stack-hang-bins-ph-711253 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/16-x-22-3-mil-flat-poly-bag-ph-311969 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-7-8-x-11-1-8-x-4-blue-shelf-bins-ph-711373 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-7-8-x-11-1-8-x-4-green-shelf-bins-ph-711375 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-7-8-x-11-1-8-x-4-red-shelf-bins-ph-711377 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-7-8-x-11-1-8-x-4-yellow-shelf-bins-ph-711379 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-7-8-x-4-1-8-x-4-blue-shelf-bins-ph-711343 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-7-8-x-4-1-8-x-4-clear-shelf-bins-ph-711345 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-7-8-x-4-1-8-x-4-green-shelf-bins-ph-711347 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-7-8-x-4-1-8-x-4-red-shelf-bins-ph-711349 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-7-8-x-4-1-8-x-4-yellow-shelf-bins-ph-711351 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-7-8-x-6-5-8-x-4-blue-shelf-bins-ph-711353 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-7-8-x-6-5-8-x-4-clear-shelf-bins-ph-711355 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-7-8-x-6-5-8-x-4-green-shelf-bins-ph-711357 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-7-8-x-6-5-8-x-4-red-shelf-bins-ph-711359 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-7-8-x-6-5-8-x-4-yellow-shelf-bins-ph-711361 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-7-8-x-8-3-8-x-4-blue-shelf-bins-ph-711363 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-7-8-x-8-3-8-x-4-clear-shelf-bins-ph-711365 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-7-8-x-8-3-8-x-4-green-shelf-bins-ph-711367 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-7-8-x-8-3-8-x-4-red-shelf-bins-ph-711369 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-7-8-x-8-3-8-x-4-yellow-shelf-bins-ph-711371 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-x-10-1-4-stack-hang-bin-dividers-ph-712123 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-x-14-1-2-blue-stack-nest-lids-ph-717145 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-x-14-1-2-gray-stack-nest-lids-ph-717149 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-x-14-1-2-red-stack-nest-lids-ph-717147 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-x-14-1-2-x-12-7-8-blue-stack-nest-bin-ph-717121 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-x-14-1-2-x-12-7-8-gray-stack-nest-bin-ph-717125 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-x-14-1-2-x-12-7-8-red-stack-nest-bin-ph-717123 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-x-14-1-2-x-9-7-8-blue-stack-nest-bin-ph-717115 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-x-14-1-2-x-9-7-8-red-stack-nest-bin-ph-717117 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-x-8-1-4-stack-hang-bin-dividers-ph-712115 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/17-x-9-3-4-stack-hang-bin-dividers-ph-712121 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-wide-seal-foot-operated-impulse-sealer-ph-344147 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-11-x-10-black-stack-hang-bins-ph-711275 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-11-x-10-blue-stack-hang-bins-ph-711269 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-11-x-10-clear-stack-hang-bins-ph-711271 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-11-x-10-green-stack-hang-bins-ph-711273 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-11-x-10-red-stack-hang-bins-ph-711277 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-11-x-10-yellow-stack-hang-bins-ph-711281 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-13-x-12-blue-space-age-totes-ph-716109 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-13-x-12-red-space-age-totes-ph-716111 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-13-x-12-white-space-age-totes-ph-716107 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-13-x-6-blue-space-age-totes-ph-716103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-13-x-6-red-space-age-totes-ph-716105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-13-x-6-white-space-age-totes-ph-716101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-14-x-12-20-pack-corrugated-box-ph-103703 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-16-1-2-x-11-black-conductive-bins-ph-711425 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-16-1-2-x-11-black-stack-hang-bin-ph-711289 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-16-1-2-x-11-blue-stack-hang-bins-ph-711283 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-16-1-2-x-11-green-stack-hang-bin-ph-711287 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-16-1-2-x-11-ivory-stack-hang-bin-ph-711293 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-16-1-2-x-11-red-stack-hang-bins-ph-711291 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-16-1-2-x-11-yellow-stack-hang-bin-ph-711295 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-19-wall-mounted-panel-rack-ph-714103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-22-1-1-2-mil-flat-poly-bag-ph-311946 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-22-3-mil-flat-poly-bag-ph-311959 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-27-green-waterhog-mat-ph-737169 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-30-4-mil-reclosable-poly-bag-ph-315618 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-36-1-1-2-mil-flat-poly-bag-ph-311945 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-8-1-4-x-9-black-stack-hang-bins-ph-711261 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-8-1-4-x-9-blue-stack-hang-bins-ph-711255 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-8-1-4-x-9-clear-stack-hang-bins-ph-711257 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-8-1-4-x-9-green-stack-hang-bins-ph-711259 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-8-1-4-x-9-ivory-stack-hang-bins-ph-711265 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-8-1-4-x-9-red-stack-hang-bins-ph-711263 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/18-x-8-1-4-x-9-yellow-stack-hang-bins-ph-711267 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-7-8-x-3-plastic-shelf-bin-dividers-ph-712125 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-10-black-marble-anti-fatigue-mat-ph-737122 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-10-black-yellow-anti-fatigue-mat-ph-737339 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-105-corrugated-rib-runners-ph-737576 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-110-yds-caution-if-seal-is-broke-printed-tape-ph-617005 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-110-yds-clear-3m-3199-security-tape-ph-616041 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-16-black-economy-anti-fatigue-mat-ph-737341 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-3-6-mil-anti-static-flat-poly-bag-ph-331293 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-3-green-superior-vinyl-carpet-mat-ph-737480 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-3-walnut-marble-anti-fatigue-mat-ph-737108 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-4-4-mil-white-block-reclosable-poly-bag-ph-317289 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-4-warning-hazardous-voltage-durable-safety-label-ph-414049 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-5-black-premium-anti-fatigue-mat-ph-737406 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-5-yds-clear-3m-f9473.c-vhb-tape-ph-696179 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-55-yds-fragile-box-printed-box-tape-ph-617099 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-55-yds-tan-400-industrial-tape-ph-612183 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-60-black-economy-anti-fatigue-mat-ph-737347 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-60-gray-economy-anti-fatigue-mat-ph-737349 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-60-yds-3m-101+-masking-tape-ph-681705 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-60-yds-3m-201+-masking-tape-ph-681707 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-60-yds-3m-2460-flatback-tape-ph-624069 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-60-yds-3m-2515-flatback-tape-ph-624081 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-60-yds-3m-301+-masking-tape-ph-681749 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-60-yds-3m-401+-233+-masking-tape-ph-681751 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-60-yds-3m-501+-masking-tape-ph-681753 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-60-yds-blue-secure-tape-ph-616003 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-8-black-economy-anti-fatigue-mat-ph-737335 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-8-black-premium-anti-fatigue-mat-ph-737410 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2-x-8-premium-anti-fatigue-mat-ph-737411 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/2.52-x-1181-black-datamax-thermal-transfer-ribbons-wax-ph-415119 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/20-1-4-x-14-1-4-x-12-3-4-round-trip-tote-ph-717103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/20-1-4-x-14-1-4-x-9-5-8-round-trip-tote-ph-717101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/20-7-8-x-18-1-4-gray-stack-nest-lids-ph-717155 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/20-7-8-x-18-1-4-red-stack-nest-lids-ph-717153 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/20-7-8-x-18-1-4-x-9-7-8-blue-stack-nest-bin-ph-717127 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/20-7-8-x-18-1-4-x-9-7-8-gray-stack-nest-bin-ph-717131 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/20-7-8-x-18-1-4-x-9-7-8-red-stack-nest-bin-ph-717129 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/22-1-2-x-24-1-2-black-can-liners-ph-751137 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/22-1-2-x-24-1-2-black-can-liners-ph-751141 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/225-triangle-entanglement-hazard-durable-safety-label-ph-414109 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/23-5-8-x-11-1-8-x-4-blue-shelf-bins-ph-711411 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/23-5-8-x-11-1-8-x-4-green-shelf-bins-ph-711413 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/23-5-8-x-4-1-8-x-4-blue-shelf-bins-ph-711381 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/23-5-8-x-4-1-8-x-4-clear-shelf-bins-ph-711383 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/23-5-8-x-4-1-8-x-4-green-shelf-bins-ph-711385 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/23-5-8-x-4-1-8-x-4-yellow-shelf-bins-ph-711389 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/23-5-8-x-6-5-8-x-4-blue-shelf-bins-ph-711391 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/23-5-8-x-6-5-8-x-4-clear-shelf-bins-ph-711393 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/23-5-8-x-6-5-8-x-4-green-shelf-bins-ph-711395 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/23-5-8-x-6-5-8-x-4-red-shelf-bins-ph-711397 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/23-5-8-x-6-5-8-x-4-yellow-shelf-bins-ph-711399 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/23-5-8-x-8-3-8-4-red-shelf-bins-ph-711407 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/23-5-8-x-8-3-8-x-4-blue-shelf-bins-ph-711401 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/23-5-8-x-8-3-8-x-4-clear-shelf-bins-ph-711403 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/23-5-8-x-8-3-8-x-4-green-shelf-bins-ph-711405 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/23-5-8-x-8-3-8-x-4-yellow-shelf-bins-ph-711409 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/23-x-15-x-16-blue-space-age-totes-ph-716115 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/23-x-33-black-can-liners-ph-751143 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/23-x-33-black-can-liners-ph-751145 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/23-x-33-black-can-liners-ph-751147 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/24-x-23-clear-can-liners-ph-751101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/24-x-23-clear-can-liners-ph-751103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/24-x-24-4-mil-anti-static-poly-bag-ph-331277 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/24-x-31-clear-can-liners-ph-751105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/24-x-31-clear-can-liners-ph-751107 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/25-3-4-x-16-x-12-1-2-round-trip-tote-ph-717105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/26-5-8-x-18-1-4-gray-stack-nest-lids-ph-717161 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/26-5-8-x-18-1-4-x-14-7-8-blue-stack-nest-bin-ph-717133 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/26-5-8-x-18-1-4-x-14-7-8-gray-stack-nest-bin-ph-717137 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/26-x-19-x-15-5-8-gray-round-trip-tote-ph-717107 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/28-x-18-x-11-gray-brute-totes-with-lid-ph-717163 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/28-x-18-x-11-white-brute-totes-w-lid-ph-717165 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/28-x-18-x-15-gray-brute-totes-with-lid-ph-717167 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/28-x-18-x-15-white-brute-totes-w-lid-ph-717169 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-1-4-x-1-3-4-x-3-blue-shelf-bin-cups-ph-713101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-1-4-x-1-3-4-x-3-yellow-shelf-bin-cups-ph-713103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-4-x-60-yds-3m-301+-masking-tape-ph-681335 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-4-x-60-yds-3m-301+-masking-tape-ph-681447 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-4-x-60-yds-3m-401+-233+-masking-tape-ph-681339 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-4-x-60-yds-3m-401+-233+-masking-tape-ph-681451 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-4-x-60-yds-3m-501+-masking-tape-ph-681343 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-4-x-60-yds-3m-501+-masking-tape-ph-681455 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-4-x-60-yds-3m-860-poly-strapping-tape-ph-643025 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-in-1-safety-cutter-left-handed-ph-732155 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-10-black-economy-anti-fatigue-mat-ph-737365 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-10-black-marble-anti-fatigue-mat-ph-737138 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-10-black-yellow-anti-fatigue-mat-ph-737366 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-10-brown-deluxe-entry-mat-ph-737454 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-10-brown-waterhog-elite-mat-ph-737399 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-10-brown-waterhog-mat-ph-737203 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-10-burgundy-deluxe-entry-mat-ph-737453 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-10-charcoal-deluxe-entry-mat-ph-737455 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-10-charcoal-vinyl-carpet-mat-ph-737530 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-10-green-waterhog-mat-ph-737205 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-10-red-black-waterhog-mat-ph-737208 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-105-corrugated-rib-runners-ph-737577 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-12-black-yellow-anti-fatigue-mat-ph-737369 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-12-charcoal-vinyl-carpet-mat-ph-737535 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-12-hog-heaven-nitrile-mats-ph-737570 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-12-medium-gray-waterhog-mat-ph-737212 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-12-navy-waterhog-mat-ph-737213 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-12-red-black-waterhog-mat-ph-737214 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-15-black-economy-anti-fatigue-mat-ph-737371 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-15-blue-marble-anti-fatigue-mat-ph-737141 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-15-gray-economy-anti-fatigue-mat-ph-737373 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-16-brown-waterhog-mat-ph-737215 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-16-green-waterhog-mat-ph-737217 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-16-medium-gray-waterhog-mat-ph-737218 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-16-premium-anti-fatigue-mat-ph-737435 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-16-red-black-waterhog-mat-ph-737220 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-20-charcoal-waterhog-runner-ph-737306 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-20-green-waterhog-runner-ph-737307 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-20-medium-gray-waterhog-runner-ph-737308 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-20-navy-waterhog-runner-ph-737309 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-20-red-black-waterhog-runner-ph-737310 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-30-3-mil-flat-poly-bag-ph-311194 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-4-medium-gray-waterhog-mat-ph-737182 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-4-premium-anti-fatigue-mat-ph-737421 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-4-red-deluxe-vinyl-carpet-mat-ph-737464 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-5-brown-deluxe-entry-mat-ph-737451 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-5-brown-waterhog-mat-ph-737185 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-5-charcoal-deluxe-entry-mat-ph-737452 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-5-charcoal-deluxe-vinyl-carpet-mat-ph-737465 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-5-charcoal-economy-vinyl-carpet-mat-ph-737515 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-5-premium-anti-fatigue-mat-ph-737423 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-5-slip-guard-drainage-mat-ph-737150 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-6-8-mil-reclosable-poly-bag-ph-315192 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-6-black-premium-anti-fatigue-mat-ph-737424 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-6-black-yellow-anti-fatigue-mat-ph-737357 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-6-charcoal-economy-vinyl-carpet-mat-ph-737520 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-6-charcoal-waterhog-mat-ph-737192 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-6-gray-economy-anti-fatigue-mat-ph-737358 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-6-green-waterhog-mat-ph-737193 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-6-premium-anti-fatigue-mat-ph-737425 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-60-black-yellow-anti-fatigue-mat-ph-737375 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-60-blue-economy-vinyl-carpet-mat-ph-737543 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-60-brown-economy-vinyl-carpet-mat-ph-737544 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-60-charcoal-vinyl-carpet-mat-ph-737545 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-60-forest-green-vinyl-carpet-mat-ph-737546 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-60-premium-anti-fatigue-mat-ph-737437 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-60-red-economy-vinyl-carpet-mat-ph-737547 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-60-yds-3m-301+-masking-tape-ph-681789 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-60-yds-3m-401+-233+-masking-tape-ph-681791 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-75-corrugated-rib-runners-ph-737575 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-8-black-economy-anti-fatigue-mat-ph-737359 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-8-black-premium-anti-fatigue-mat-ph-737428 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-8-black-yellow-anti-fatigue-mat-ph-737360 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-8-charcoal-economy-vinyl-carpet-mat-ph-737525 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-8-green-waterhog-mat-ph-737199 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-8-premium-anti-fatigue-mat-ph-737429 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-8-red-black-waterhog-mat-ph-737202 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-9-black-yellow-anti-fatigue-mat-ph-737363 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3-x-9-slip-guard-drainage-mat-ph-737151 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3.00-x-1181-black-datamax-thermal-transfer-ribbons-ph-415125 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3.14-x-1476-black-zebra-thermal-transfer-ribbons-ph-415131 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3.14-x-1476-black-zebra-thermal-transfer-ribbons-wax-ph-415129 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3.15-x-984-black-zebra-thermal-transfer-ribbons-ph-415135 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3.15-x-984-black-zebra-thermal-transfer-ribbons-wax-ph-415133 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3.27-x-1476-black-zebra-thermal-transfer-ribbons-wax-ph-415139 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3.50-x-1181-black-datamax-thermal-transfer-ribbons-wax-ph-415143 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/30-x-36-black-can-liners-ph-751149 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/30-x-36-black-can-liners-ph-751151 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/30-x-36-clear-can-liners-ph-751109 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/30-x-36-clear-can-liners-ph-751111 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/30-x-60-3-mil-flat-poly-bag-ph-312392 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/33-x-39-clear-can-liners-ph-751113 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/33-x-39-clear-can-liners-ph-751115 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/33-x-39-clear-can-liners-ph-751117 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/33-x-40-black-can-liners-ph-751153 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/33-x-40-black-can-liners-ph-751155 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/33-x-40-black-can-liners-ph-751157 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/33-x-40-black-can-liners-ph-751159 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/33-x-40-black-can-liners-ph-751161 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/33-x-40-black-can-liners-ph-751163 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/33-x-40-black-can-liners-ph-751165 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-12-1-2-x-66-floor-rack-bin-organizer-ph-714109 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-12-wire-shelves-ph-715327 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-12-x-54-4-shelf-wire-shelving-ph-715101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-12-x-54-wire-shelving-add-on-unit-ph-715105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-12-x-74-4-shelf-wire-shelving-ph-715117 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-12-x-74-wire-shelving-add-on-unit-ph-715121 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-12-x-86-4-shelf-wire-shelving-ph-715125 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-12-x-86-wire-shelving-add-on-unit-ph-715129 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-18-wire-shelf-ph-715329 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-18-wire-shelves-ph-715331 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-18-x-54-4-shelf-wire-shelving-ph-715133 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-18-x-54-wire-shelving-add-on-unit-ph-715137 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-18-x-63-4-shelf-wire-shelving-ph-715141 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-18-x-63-wire-shelving-add-on-unit-ph-715145 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-18-x-74-4-shelf-wire-shelving-ph-715149 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-18-x-74-wire-shelving-add-on-unit-ph-715153 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-18-x-86-wire-shelving-add-on-unit-ph-715161 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-19-wall-mounted-panel-rack-ph-714105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-24-wire-shelf-ph-715333 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-24-wire-shelves-ph-715335 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-24-x-12-corrugated-boxes-ph-103605 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-24-x-54-4-shelf-wire-shelving-ph-715165 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-24-x-63-4-shelf-wire-shelving-ph-715169 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-24-x-63-wire-shelving-add-on-unit-ph-715171 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-24-x-74-4-shelf-wire-shelving-ph-715173 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-24-x-74-wire-shelving-add-on-unit-ph-715175 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-24-x-86-4-shelf-wire-shelving-ph-715177 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-24-x-86-wire-shelving-add-on-unit-ph-715179 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-58-black-can-liners-ph-751181 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-58-black-can-liners-ph-751183 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-58-black-can-liners-ph-751185 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-58-clear-can-liners-ph-751129 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-58-clear-can-liners-ph-751131 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/36-x-58-clear-can-liners-ph-751133 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/37-x-1000-scott-surpass-toliet-tissue-ph-821015 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/38-x-48-3-mil-flat-poly-bag-ph-312395 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/39-x-46-sure-sak-can-liners-ph-752105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/39-x-56-sure-sak-can-liners-ph-752107 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3m-1100-foam-earplugs-ph-725101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3m-6003-reusable-respirator-ph-723107 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3m-6300-half-face-respirator-large-ph-723111 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3m-8200-dust-respirator-ph-723113 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3m-8210-dust-respirator-ph-723115 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3m-8271-oil-proof-respirator-with-valve-ph-723119 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/3m-8515-welding-respirator-with-valve-ph-723123 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-5-8-x-2-13-16-stack-hang-dividers-ph-712101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-10-black-premium-anti-fatigue-mat-ph-737444 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-10-black-yellow-anti-fatigue-mat-ph-737384 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-10-brown-waterhog-mat-ph-737245 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-10-green-waterhog-mat-ph-737247 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-10-medium-gray-waterhog-mat-ph-737248 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-12-6-mil-reclosable-poly-bag-ph-315377 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-12-black-economy-anti-fatigue-mat-ph-737386 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-12-brown-waterhog-mat-ph-737251 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-12-green-waterhog-mat-ph-737253 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-12-medium-gray-waterhog-mat-ph-737254 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-12-red-black-waterhog-mat-ph-737256 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-16-black-yellow-anti-fatigue-mat-ph-737390 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-16-brown-waterhog-mat-ph-737257 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-16-green-waterhog-mat-ph-737259 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-16-navy-waterhog-mat-ph-737261 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-16-red-black-waterhog-mat-ph-737262 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-18-6-mil-reclosable-poly-bag-ph-315379 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-20-brown-waterhog-runner-ph-737293 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-20-charcoal-waterhog-runner-ph-737294 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-20-green-waterhog-runner-ph-737295 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-20-medium-gray-waterhog-runner-ph-737296 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-20-navy-waterhog-runner-ph-737297 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-20-red-black-waterhog-runner-ph-737298 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-4-green-waterhog-mat-ph-737223 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-4-navy-waterhog-mat-ph-737225 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-4-non-flammable-gas-labels-ph-413073 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-4-red-black-waterhog-mat-ph-737226 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-6-black-economy-anti-fatigue-mat-ph-737380 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-6-black-premium-anti-fatigue-mat-ph-737440 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-6-black-yellow-anti-fatigue-mat-ph-737381 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-6-blue-marble-anti-fatigue-mat-ph-737145 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-6-brown-superior-vinyl-carpet-mat-ph-737496 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-6-brown-waterhog-elite-mat-ph-737402 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-6-brown-waterhog-mat-ph-737233 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-6-burgundy-deluxe-entry-mat-ph-737456 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-6-charcoal-deluxe-vinyl-carpet-mat-ph-737474 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-6-charcoal-waterhog-mat-ph-737234 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-6-forest-green-deluxe-vinyl-carpet-ph-737475 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-6-gray-economy-anti-fatigue-mat-ph-737382 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-6-gray-marble-anti-fatigue-mat-ph-737147 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-6-green-waterhog-mat-ph-737235 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-6-job-ticket-holders-ph-731101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-6-red-black-waterhog-mat-ph-737238 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-60-black-yellow-anti-fatigue-mat-ph-737393 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-60-brown-economy-vinyl-carpet-mat-ph-737564 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-60-red-economy-vinyl-carpet-mat-ph-737567 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-8-brown-waterhog-mat-ph-737239 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-8-charcoal-economy-vinyl-carpet-mat-ph-737555 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/4-x-8-medium-gray-waterhog-mat-ph-737242 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/40-x-40-3-mil-flat-poly-bag-ph-312467 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/40-x-46-black-can-liners-ph-751167 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/40-x-46-black-can-liners-ph-751169 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/40-x-46-black-can-liners-ph-751171 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/40-x-46-black-can-liners-ph-751173 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/40-x-46-black-can-liners-ph-751175 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/40-x-46-black-can-liners-ph-751179 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/40-x-46-clear-can-liners-ph-751121 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/40-x-46-clear-can-liners-ph-751123 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/40-x-46-clear-can-liners-ph-751125 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/40-x-46-clear-can-liners-ph-751127 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-12-wire-shelf-ph-715337 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-12-wire-shelves-ph-715339 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-12-x-54-4-shelf-wire-shelving-ph-715181 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-12-x-54-wire-shelving-add-on-unit-ph-715183 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-12-x-63-4-shelf-wire-shelving-ph-715185 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-12-x-63-wire-shelving-add-on-unit-ph-715187 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-12-x-74-4-shelf-wire-shelving-ph-715189 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-12-x-74-wire-shelving-add-on-unit-ph-715191 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-12-x-86-4-shelf-wire-shelving-ph-715193 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-12-x-86-wire-shelving-add-on-unit-ph-715195 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-18-wire-shelf-ph-715341 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-18-wire-shelves-ph-715343 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-18-x-54-4-shelf-wire-shelving-ph-715197 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-18-x-54-wire-shelving-add-on-unit-ph-715199 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-18-x-63-4-shelf-wire-shelving-ph-715201 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-18-x-63-wire-shelving-add-on-unit-ph-715203 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-18-x-74-4-shelf-wire-shelving-ph-715205 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-18-x-86-4-shelf-wire-shelving-ph-715209 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-18-x-86-wire-shelving-add-on-unit-ph-715211 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-24-wire-shelf-ph-715345 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-24-wire-shelves-4-pack-ph-715347 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-24-x-54-4-shelf-wire-shelving-ph-715213 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-24-x-54-wire-shelving-add-on-unit-ph-715215 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-24-x-63-4-shelf-wire-shelving-ph-715217 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-24-x-63-wire-shelving-add-on-unit-ph-715219 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-24-x-74-4-shelf-wire-shelving-ph-715221 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-24-x-86-4-shelf-wire-shelving-ph-715225 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/48-x-24-x-86-wire-shelving-add-on-unit-ph-715227 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-1-2-x-10-red-border-airbill-envelope-document-envelope-ph-459005 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-1-4-x-2-1-4-x-15-1-1-2-mil-gusseted-poly-bag-ph-318141 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-1-4-x-3-plastic-shelf-bin-dividers-ph-712127 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-1-8-x-2-3-4-x-3-blue-shelf-bin-cups-ph-713105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-1-8-x-2-3-4-x-3-yellow-shelf-bin-cups-ph-713107 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-black-stack-hang-bin-ph-711107 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-blue-stack-hang-bin-ph-711101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-clear-stack-hang-bin-ph-711103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-green-stack-hang-bin-ph-711105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-ivory-stack-hang-bin-ph-711111 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-red-stack-hang-bins-ph-711109 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-yellow-stack-hang-bin-ph-711113 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-shelf-wire-shelving-with-blue-bins-ph-715151 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-shelf-wire-shelving-with-green-bins-ph-715155 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-shelf-wire-shelving-with-red-bins-ph-715159 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-shelf-wire-shelving-with-yellow-bins-ph-715163 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-x-1-1-4-polyurethane-swivel-casters-ph-715389 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-x-11-2-mil-flat-poly-bag-ph-311427 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-x-20-4-mil-reclosable-poly-bag-ph-315361 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-x-24-2-mil-reclosable-poly-bag-ph-315321 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-x-36-2-mil-flat-poly-bag-ph-311428 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-x-5-x-25-kraft-square-mailing-tubes-ph-213657 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/5-x-7-2-milhangholereclosable-poly-bag-ph-315054 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/54-chrome-poles-2-pack-ph-715373 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-5-8-x-2-3-4-stack-hang-bin-dividers-ph-712105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-shelf-wire-shelving-with-blue-bins-ph-715119 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-shelf-wire-shelving-with-blue-bins-ph-715135 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-shelf-wire-shelving-with-green-bins-ph-715123 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-shelf-wire-shelving-with-green-bins-ph-715139 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-shelf-wire-shelving-with-red-bins-ph-715127 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-shelf-wire-shelving-with-yellow-bins-ph-715131 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-shelf-wire-shelving-with-yellow-bins-ph-715147 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-10-brown-waterhog-mat-ph-737275 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-10-charcoal-waterhog-mat-ph-737276 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-10-green-waterhog-mat-ph-737277 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-10-kraft-0-padded-mailers-ph-251105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-10-medium-gray-waterhog-mat-ph-737278 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-100ga-2625-poly-olefin-shrink-film-ph-384109 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-12-brown-waterhog-mat-ph-737281 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-12-charcoal-waterhog-mat-ph-737282 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-12-green-waterhog-mat-ph-737283 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-12-navy-waterhog-mat-ph-737285 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-12-red-black-waterhog-mat-ph-737286 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-16-brown-waterhog-mat-ph-737287 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-16-medium-gray-waterhog-mat-ph-737290 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-16-navy-waterhog-mat-ph-737291 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-16-red-black-waterhog-mat-ph-737292 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-20-brown-waterhog-runner-ph-737299 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-20-charcoal-waterhog-runner-ph-737300 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-20-green-waterhog-runner-ph-737301 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-20-medium-gray-waterhog-runner-ph-737302 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-20-red-black-waterhog-runner-ph-737304 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-30-4-mil-reclosable-poly-bag-ph-315367 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-6-brown-waterhog-mat-ph-737263 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-6-charcoal-waterhog-mat-ph-737264 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-6-green-waterhog-mat-ph-737265 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-6-medium-gray-waterhog-mat-ph-737266 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-75ga-x-3500-poly-olefin-shrink-film-ph-384105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-8-4-mil-minigrip-anti-static-reclosable-poly-bag-ph-313217 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-8-brown-waterhog-mat-ph-737269 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-8-charcoal-waterhog-mat-ph-737270 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-8-green-waterhog-mat-ph-737271 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-8-medium-gray-waterhog-mat-ph-737272 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-8-red-black-waterhog-mat-ph-737274 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-9-job-ticket-holders-ph-731105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/6-x-9-red-job-ticket-holders-ph-731119 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/60-x-18-wire-shelves-2-pack-ph-715351 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/60-x-18-x-54-4-shelf-wire-shelving-ph-715229 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/60-x-18-x-63-4-shelf-wire-shelving-ph-715233 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/60-x-18-x-63-wire-shelving-add-on-unit-ph-715235 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/60-x-18-x-74-4-shelf-wire-shelving-ph-715237 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/60-x-18-x-86-4-shelf-wire-shelving-ph-715241 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/60-x-18-x-86-wire-shelving-add-on-unit-ph-715243 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/60-x-24-wire-shelf-ph-715353 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/60-x-24-x-54-4-shelf-wire-shelving-ph-715245 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/60-x-24-x-74-4-shelf-wire-shelving-ph-715253 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/60-x-24-x-74-wire-shelving-add-on-unit-ph-715255 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/60-x-24-x-86-4-shelf-wire-shelving-ph-715257 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/60-x-24-x-86-wire-shelving-add-on-unit-ph-715259 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/60-x-36-wire-shelves-2-pack-ph-715359 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/60-x-36-x-54-4-shelf-wire-shelving-ph-715261 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/60-x-36-x-54-wire-shelving-add-on-unit-ph-715263 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/60-x-36-x-63-4-shelf-wire-shelving-ph-715265 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/60-x-36-x-63-wire-shelving-add-on-unit-ph-715267 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/60-x-36-x-74-4-shelf-wire-shelving-ph-715269 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/60-x-36-x-86-wire-shelving-add-on-unit-ph-715275 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/63-chrome-poles-2-pack-ph-715377 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/63-chrome-poles-4-pack-ph-715379 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-black-conductive-bins-ph-711419 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-black-stack-hang-bin-ph-711121 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-clear-stack-hang-bin-ph-711117 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-ivory-stack-hang-bin-ph-711125 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-red-stack-hang-bins-ph-711123 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-yellow-stack-hang-bin-ph-711127 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/7-x-3-plastic-shelf-bin-dividers-ph-712129 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/7-x-8-4-mil-white-block-reclosable-poly-bag-ph-317165 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/72-x-18-wire-shelf-ph-715361 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/72-x-18-wire-shelves-2-pack-ph-715363 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/72-x-18-x-54-4-shelf-wire-shelving-ph-715277 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/72-x-18-x-63-wire-shelving-add-on-unit-ph-715283 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/72-x-18-x-74-4-shelf-wire-shelving-ph-715285 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/72-x-18-x-74-wire-shelving-add-on-unit-ph-715287 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/72-x-18-x-84-wire-shelving-add-on-unit-ph-715279 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/72-x-24-wire-shelf-2-pack-ph-715365 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/72-x-24-x-54-4-shelf-wire-shelving-ph-715293 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/72-x-24-x-54-wire-shelving-add-on-unit-ph-715295 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/72-x-24-x-63-4-shelf-wire-shelving-ph-715297 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/72-x-24-x-63-wire-shelving-add-on-unit-ph-715299 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/72-x-24-x-74-4-shelf-wire-shelving-ph-715301 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/72-x-24-x-86-wire-shelving-add-on-unit-ph-715307 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/72-x-36-wire-shelves-2-pack-ph-715371 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/72-x-36-x-54-4-shelf-wire-shelving-ph-715309 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/72-x-36-x-63-4-shelf-wire-shelving-ph-715313 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/72-x-36-x-63-wire-shelving-add-on-unit-ph-715315 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/72-x-36-x-74-4-shelf-wire-shelving-ph-715317 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/72-x-36-x-86-wire-shelving-add-on-unit-ph-715323 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/74-chrome-poles-2-pack-ph-715381 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/74-chrome-poles-4-pack-ph-715383 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/8-1-2-x-11-job-ticket-holders-ph-731107 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/8-1-2-x-11-solid-back-job-ticket-holder-ph-731137 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/8-1-2-x-12-kraft-2-padded-mailers-ph-251125 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/8-1-2-x-14-1-2-kraft-3-padded-mailers-ph-251135 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/8-3-8-x-4-1-2-stack-hang-bin-dividers-ph-712103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/8-pt-steel-track-snap-utility-knife-ph-732139 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/8-pt-steel-track-utility-knife-w-grip-ph-732135 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/8-shelf-wire-shelving-with-blue-bins-ph-715103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/8-shelf-wire-shelving-with-yellow-bins-ph-715115 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/8-x-30-4-mil-reclosable-poly-bag-ph-315375 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/8-x-4-x-15-2-mil-gusseted-reclosable-poly-bag-ph-318325 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/86-chrome-poles-ph-715385 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/86-chrome-poles-ph-715387 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-1-4-x-6-x-5-black-stack-hang-bins-ph-711135 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-1-4-x-6-x-5-clear-stack-hang-bins-ph-711131 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-1-4-x-6-x-5-red-stack-hang-bins-ph-711137 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-1-4-x-6-x-5-yellow-stack-hang-bins-ph-711141 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-5-8-x-6-5-8-x-3-1-2-kraft-easy-fold-mailer-ph-212125 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-7-8-x-6-3-4-stack-hang-bin-dividers-ph-712107 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-x-12-4-mil-minigrip-anti-static-reclosable-poly-bag-ph-313259 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-x-12-dual-pocket-job-ticket-holders-ph-731149 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-x-12-heavyweight-job-ticket-holders-ph-731155 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-x-12-job-ticket-holders-with-strap-ph-731145 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-x-12-magnetic-job-ticket-holders-ph-731153 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-x-12-neon-blue-job-ticket-holders-ph-731121 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-x-12-neon-green-job-ticket-holders-ph-731123 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-x-12-neon-job-ticket-holders-pack-ph-731143 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-x-12-neon-orange-job-ticket-holders-ph-731125 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-x-12-neon-pink-job-ticket-holders-ph-731127 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-x-12-neon-red-job-ticket-holders-ph-731129 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-x-12-neon-yellow-job-ticket-holders-ph-731131 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-x-12-red-deluxe-job-ticket-holders-ph-731151 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-x-12-solid-back-job-ticket-holders-ph-731141 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-x-12-x-1-gusseted-job-ticket-holders-ph-731147 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-x-12-zippered-job-ticket-holders-ph-731161 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/9-x-16-1-1-2-mil-flat-poly-bag-ph-311695 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/all-purpose-first-aid-kit-25-person-ph-724101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/ambidextrous-spring-back-safety-cutter-ph-732195 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/angel-soft-toliet-tissue-dispenser-pack-ph-824001 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/ansell-conform-xt-latex-exam-glove-l-ph-891005 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/ansell-tnt-nitrile-gloves-xlarge-ph-891015 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/ansell-touch-n-tuff-nitrile-glove-xl-ph-891023 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/ansell-touch-n-tuff-nitrile-gloves-l-ph-891021 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/ansell-touch-n-tuff-nitrile-gloves-m-ph-891019 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/aosafety-chemical-splash-goggles-334-ph-722103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/auto-retracting-swivel-holster-ph-732157 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/avoid-a-fall-9-x-6-facility-sign-ph-781157 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/banding-and-strapping-safety-cutter-ph-732197 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/bc-347-safety-bag-cutter-ph-732199 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/bedford-2-ply-toilet-tissue-ph-821003 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/best-7500-nitrile-gloves-xlarge-ph-891135 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/best-nighthawk-nitrile-gloves-large-ph-891045 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/best-nighthawk-nitrile-gloves-medium-ph-891043 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/best-nighthawk-nitrile-gloves-small-ph-891041 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/best-nighthawk-nitrile-gloves-xlarge-ph-891047 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/bkb-18-13-pt-snap-blades-ph-732185 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/black-marsh-88-valve-markers-ph-734103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/black-marsh-88fx-metal-paint-markers-ph-734109 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/black-sharpie-chisel-tip-markers-ph-734153 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/black-sharpie-fine-point-markers-ph-734121 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/black-sharpie-king-size-markers-ph-734139 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/black-sharpie-magnum-markers-ph-734145 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/black-super-sharpie-markers-ph-734133 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/blade-bank-ph-732207 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/blue-marsh-88fx-metal-paint-markers-ph-734107 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/blue-recycling-trash-bag-13-gal-11-mil-ph-757101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/blue-recycling-trash-bag-13-gal-15-mil-ph-757103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/blue-recycling-trash-bag-33-gal-15-mil-ph-757111 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/blue-recycling-trash-bag-55-60-gal-ph-757117 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/blue-sharpie-chisel-tip-markers-ph-734151 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/blue-sharpie-fine-point-markers-ph-734119 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/blue-sharpie-king-size-markers-ph-734137 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/blue-sharpie-magnum-markers-ph-734143 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/blue-spring-back-pocket-safety-cutter-ph-732179 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/box-of-huck-towels-blue-25-lb-box-ph-827047 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/box-of-rags-colored-t-shirt-25-lb-box-ph-827043 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/box-of-rags-colored-t-shirt-50-lb-box-ph-827045 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/box-of-rags-premium-white-10-lb-box-ph-827025 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/box-of-rags-premium-white-25-lb-box-ph-827027 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/box-of-rags-premium-white-50-lb-box-ph-827029 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/box-of-rags-standard-10-lb-box-ph-827019 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/box-of-rags-standard-50-lb-box-ph-827023 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-domed-trash-can-lid-44-gal-blue-ph-743237 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-flat-trash-can-lid-10-gal-white-ph-743155 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-flat-trash-can-lid-10-gallon-gray-ph-743151 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-flat-trash-can-lid-20-gal-black-ph-743173 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-flat-trash-can-lid-20-gal-yellow-ph-743185 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-flat-trash-can-lid-20-gallon-blue-ph-743175 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-flat-trash-can-lid-20-gallon-gray-ph-743179 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-flat-trash-can-lid-20-gallon-red-ph-743181 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-flat-trash-can-lid-44-gal-black-ph-743243 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-flat-trash-can-lid-44-gal-green-ph-743247 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-flat-trash-can-lid-44-gallon-blue-ph-743245 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-flat-trash-can-lid-44-gallon-gray-ph-743249 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-flat-trash-can-lid-55-gal-black-ph-743275 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-flat-trash-can-lid-55-gal-green-ph-743279 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-flat-trash-can-lid-55-gal-white-ph-743285 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-flat-trash-can-lid-55-gal-yellow-ph-743287 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-flat-trash-can-lid-55-gallon-blue-ph-743277 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-recycling-container-32-gal-blue-ph-742123 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-recycling-container-32-gal-green-ph-742125 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-recycling-single-stream-lid-green-ph-742121 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-roll-out-container-50-gallon-gray-ph-747101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-square-can-flat-lid-28-gal-gray-ph-743107 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-square-can-flat-lid-28-gal-white-ph-743111 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-square-can-flat-lid-40-gal-gray-ph-743117 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-square-can-flat-lid-40-gal-white-ph-743119 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-square-dolly-ph-743121 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-square-trash-can-28-gallon-gray-ph-743101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-square-trash-can-28-gallon-red-ph-743103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-square-trash-can-40-gallon-gray-ph-743113 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-steel-dome-lid-55-gallon-green-ph-743291 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-steel-dome-lid-55-gallon-red-ph-743293 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-trash-can-10-gallon-black-ph-743131 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-trash-can-10-gallon-blue-ph-743133 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-trash-can-10-gallon-gray-ph-743137 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-trash-can-10-gallon-red-ph-743139 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-trash-can-10-gallon-white-ph-743141 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-trash-can-10-gallon-yellow-ph-743143 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-trash-can-20-gallon-black-ph-743159 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-trash-can-20-gallon-blue-ph-743161 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-trash-can-20-gallon-gray-ph-743165 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-trash-can-20-gallon-green-ph-743163 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-trash-can-20-gallon-white-ph-743169 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-trash-can-32-gallon-blue-ph-743189 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-trash-can-32-gallon-white-ph-743197 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-trash-can-44-gallon-blue-ph-743225 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-trash-can-44-gallon-gray-ph-743229 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-trash-can-44-gallon-green-ph-743227 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-trash-can-55-gallon-blue-ph-743259 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-trash-can-55-gallon-green-ph-743261 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-trash-can-55-gallon-white-ph-743267 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/brute-trash-can-55-gallon-yellow-ph-743269 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/charmin-2-ply-bathroom-tissue-ph-821009 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/clear-poly-gloves-1-mil-ph-891125 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/clear-poly-gloves-18-elbow-length-ph-891127 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/continuous-air-freshener-refill-blue-splash-ph-827011 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/continuous-air-freshener-refill-citrus-ph-827009 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/continuous-air-freshener-refill-mango-ph-827013 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/contractors-bag-black-30-gallon-30-mil-ph-756101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/contractors-bag-black-33-gallon-30-mil-ph-756103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/contractors-bag-black-40-45-gal-3-mil-ph-756107 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/contractors-bag-black-40-55-gal-3-mil-ph-756105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/contractors-bag-black-56-gal-30-mil-ph-756109 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/cotton-inspection-ext-cuff-glove-l-ph-891231 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/cotton-inspection-gloves-25-oz-small-ph-891227 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/cotton-inspection-gloves-35-oz-large-ph-891235 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/cotton-inspection-gloves-35-oz-small-ph-891233 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/cowhide-leather-driver-glove-lined-xl-ph-891269 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/cowhide-leather-drivers-gloves-large-ph-891261 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/cowhide-leather-drivers-gloves-lined-l-ph-891267 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/deerskin-leather-drivers-gloves-large-ph-891297 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/deerskin-leather-drivers-gloves-xlarge-ph-891299 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/deluxe-cowhide-leather-driver-glove-l-ph-891273 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/deluxe-cowhide-leather-driver-glove-xl-ph-891275 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/deluxe-urinal-screen-spiced-apple-ph-826011 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/dfc-364-disposable-film-cutter-ph-732141 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/dixie-paper-plates-10-1-4-heavyweight-ph-882101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/donut-bumpers-for-swivel-casters-ph-715391 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/door-sign-conference-ph-781173 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/door-sign-elevator-ph-781197 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/door-sign-employees-only-ph-781185 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/door-sign-entrance-ph-781177 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/door-sign-manager-ph-781175 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/door-sign-no-admittance-ph-781189 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/door-sign-no-smoking-ph-781181 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/door-sign-office-ph-781171 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/door-sign-private-ph-781187 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/door-sign-restrooms-ph-781191 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/door-sign-stairs-ph-781199 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/door-sign-storage-ph-781179 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/door-sign-watch-your-step-ph-781201 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/door-sign-women-ph-781193 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/e-a-r-classic-earplugs-in-pillow-pak-ph-725109 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/e-a-r-classic-earplugs-refill-ph-725113 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/e-a-r-earmuffs-ph-725121 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/e-a-r-one-touch-pro-earplug-dispenser-ph-725117 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/e-a-rsoft-yellow-neons-corded-earplugs-ph-725107 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/e-a-rsoft-yellow-neons-earplugs-ph-725105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/e-a-rsoft-yellow-neons-earplugs-refill-ph-725115 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/emergency-exit-only-6-x-9-facility-sign-ph-781119 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/emergency-exit-only-6-x-9-facility-sign-ph-781125 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/employees-must-wash-hands-6-x-9-facility-sign-ph-781143 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/environsweep-100-lb-ph-842001 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/esd-fingertip-coated-nylon-gloves-l-ph-891079 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/esd-palm-coated-nylon-gloves-small-ph-891081 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/esd-uncoated-nylon-gloves-extra-large-ph-891075 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/esd-uncoated-nylon-gloves-large-ph-891073 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/esd-uncoated-nylon-gloves-small-ph-891069 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/exam-grade-latex-gloves-powder-free-l-ph-891143 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/exit-6-x-9-facility-sign-ph-781121 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/ez2-concealed-blade-safety-cutter-ph-732171 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/ez3-spring-back-safety-utility-knife-ph-732133 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/ez4-guarded-spring-back-safety-cutter-ph-732103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/fingerless-pvc-dot-knit-gloves-large-ph-891417 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/fingerless-pvc-dot-knit-gloves-small-ph-891415 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/fire-alarm-9-x-6-facility-sign-ph-781155 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/fire-extinguisher-9-x-6-facility-sign-ph-781151 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/fire-hose-9-x-6-facility-sign-ph-781153 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/fluorescent-green-sharpie-highlighters-ph-734165 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/fluorescent-orange-sharpie-highlighters-ph-734167 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/fluorescent-yellow-sharpie-highlighters-ph-734169 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/glad-drawstring-trash-bag-13-gal-white-ph-753101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/glad-drawstring-trash-bag-30-gal-black-ph-753103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/glad-forceflex-trash-bag-13-gal-white-ph-753105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/glad-forceflex-trash-bag-30-gal-black-ph-753107 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/glutton-recycling-container-56-gal-blue-ph-742149 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/glutton-recycling-container-lid-56-gal-ph-742151 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/goatskin-leather-drivers-gloves-large-ph-891279 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/goatskin-leather-drivers-gloves-medium-ph-891277 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/goatskin-leather-drivers-gloves-xlarge-ph-891281 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/gojo-cherry-gel-pumice-hand-cleaner-ph-822021 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/gojo-cherry-gel-pumice-hand-cleaner-ph-822037 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/gojo-fast-wipes-(1-pack)-ph-846003 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/gojo-fast-wipes-ph-846001 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/gojo-multi-green-hand-cleaner-refill-ph-822029 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/gojo-natural-orange-smooth-hand-cleaner-refill-ph-822023 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/gojo-nxt-maximum-capacity-dispenser-ph-846009 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/gojo-wall-mount-dispenser-gray-ph-822043 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/gojo-wall-mount-dispenser-gray-ph-822045 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/gojo-wall-mount-dispenser-white-ph-822041 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/green-marsh-88fx-metal-paint-markers-ph-734111 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/green-sharpie-fine-point-markers-ph-734123 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/gritless-sweeping-compound-100-lb-bag-ph-842005 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/gritless-sweeping-compound-200-lb-bag-ph-842007 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/gritless-sweeping-compound-50-lb-bag-ph-842003 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/guarded-auto-retracting-safety-cutter-ph-732115 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/handguard-ii-gloves-large-ph-891059 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hands-free-trash-can-23-gallon-beige-ph-746109 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hands-free-trash-can-lid-23-gallon-beige-ph-746115 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hands-free-trash-can-lid-35-gallon-beige-ph-746105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hands-free-trash-can-lid-35-gallon-gray-ph-746107 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-black-33-gallon-63-mil-ph-754141 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-black-33-gallon-86-mil-ph-754143 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-black-40-45-gallon-86-mil-ph-754149 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-black-56-gallon-55-mil-ph-754151 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-black-56-gallon-67-mil-ph-754153 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-black-56-gallon-86-mil-ph-754155 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-black-6-bushel-67-mil-ph-754157 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-black-60-gallon-55-mil-ph-754159 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-black-60-gallon-67-mil-ph-754161 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-black-60-gallon-87-mil-ph-754163 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-natural-12-15-gal-31-mil-ph-754107 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-natural-20-30-gal-63-mil-ph-754113 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-natural-33-gallon-47-mil-ph-754115 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-natural-33-gallon-67-mil-ph-754117 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-natural-40-45-gal-55-mil-ph-754119 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-natural-56-gallon-67-mil-ph-754123 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-natural-60-gallon-47-mil-ph-754127 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-natural-60-gallon-55-mil-ph-754129 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-natural-60-gallon-67-mil-ph-754131 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-natural-60-gallon-86-mil-ph-754133 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-natural-7-10-gallon-23-mil-ph-754101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/hd-trash-bag-natural-7-10-gallon-31-mil-ph-754103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/heavy-duty-original-keybak-key-holder-ph-739107 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/ice-melt-ph-843001 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/industrial-first-aid-kit-50-person-ph-724103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/infectious-waste-trash-liner-30-gallon-ph-758101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/kimtech-1-ply-147-x-166-precision-low-lint-wipers-ph-844027 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/kimtech-1-ply-44-x-84-precision-low-lint-wipers-ph-844025 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/kimtech-12-x-168-prep-dispenser-box-wipers-ph-844031 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/kimtech-98-x-134-prep-jumbo-roll-wipers-ph-844033 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/kimtech-wettask-prep-wipers-ph-844039 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/kimtech-wipers-pop-up-box-ph-844041 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/kimwipes-1-ply-44-x-84-low-lint-wipers-ph-844013 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/kimwipes-3-ply-118-x-118-low-lint-wipers-ph-844019 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/kleenex-boutique-facial-tissue-ph-881000 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/kleenex-cottonelle-2-ply-bathroom-tissue-ph-821007 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/knifehandler-gloves-extra-large-ph-891067 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/knifehandler-gloves-large-ph-891065 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/knifehandler-gloves-medium-ph-891063 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/latex-glove-powder-free-w-extended-cuff-m-ph-891167 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/latex-glove-powder-free-w-extended-cuff-xl-ph-891171 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/latex-industrial-gloves-large-ph-891151 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/latex-industrial-gloves-medium-ph-891149 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/latex-industrial-gloves-powder-free-l-ph-891161 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/latex-industrial-gloves-powder-free-m-ph-891159 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/latex-industrial-gloves-powder-free-xl-ph-891163 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/latex-industrial-gloves-small-ph-891147 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/latex-industrial-gloves-xlarge-ph-891153 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/leather-palm-w-knit-wrist-gloves-l-ph-891307 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/leather-palm-w-safety-cuff-gloves-l-ph-891311 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/leather-palm-w-safety-cuff-gloves-m-ph-891309 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/leather-palm-w-safety-cuff-gloves-xl-ph-891313 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/lined-jersey-cotton-gloves-large-ph-891427 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/liners-for-sanitary-napkin-receptacles-ph-825005 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/liners-for-swing-top-sanitary-receptacle-ph-825009 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/magic-soft-facial-tissue-ph-881001 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/manual-liquid-soap-dispenser-ph-821051 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/marshal-domed-trash-can-25-gallon-beige-ph-745103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/marshal-domed-trash-can-25-gallon-black-ph-745105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/men-restroom-ada-compliant-plastic-sign-ph-781105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/men-women-accessible-ada-compliant-plastic-sign-ph-781117 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/mesh-backed-lifting-gloves-black-x-l-ph-891327 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/mesh-fingerless-glove-w-wrist-strap-m-ph-891103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/ms-410-scraper-knife-ph-732147 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/nitrile-glove-accelerator-free-s-ph-891033 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/nitrile-glove-accelerator-free-xl-ph-891039 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/nitrile-glove-extended-cuff-xl-ph-891055 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/nitrile-gloves-4-mil-large-ph-891185 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/nitrile-gloves-4-mil-medium-ph-891183 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/nitrile-gloves-4-mil-small-ph-891181 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/nitrile-gloves-4-mil-xlarge-ph-891187 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/nitrile-gloves-6-mil-large-ph-891193 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/nitrile-gloves-6-mil-xlarge-ph-891195 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/nitrile-gloves-exam-grade-medium-ph-891175 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/nitrile-gloves-exam-grade-xlarge-ph-891179 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/nitrile-gloves-with-beaded-cuff-large-ph-891223 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/nitrile-gloves-with-beaded-cuff-medium-ph-891221 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/nitrile-gloves-with-extended-cuffs-m-ph-891215 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/no-admittance-6-x-9-facility-sign-ph-781137 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/nylon-inspection-glove-mens-xl-ph-891239 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/nylon-inspection-gloves-mens-large-ph-891237 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/office-recycling-container-10-gal-blue-ph-742135 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/office-recycling-container-3-gallon-blue-ph-742133 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/oil-dry-ph-843007 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/orange-sharpie-fine-point-markers-ph-734125 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/original-keybak-retractable-key-holder-ph-739105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/paper-plates-9-ph-882100 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/peltor-optime-98-earmuffs-ph-725119 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/pigskin-leather-drivers-gloves-large-ph-891285 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/pink-sharpie-accent-highlighters-ph-734171 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/plastic-knives-ph-882001 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/please-clean-microwave-6-x-9-facility-sign-ph-781129 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/premium-safety-cutter-ambidextrous-ph-732167 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/pro-fingerless-glove-l-ph-891113 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/pro-fingerless-glove-w-wrist-strap-m-ph-891119 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/purple-sharpie-fine-point-markers-ph-734127 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/pvc-black-dot-knit-gloves-medium-ph-891405 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/pvc-black-dot-knit-gloves-small-ph-891403 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/pvc-blue-dot-knit-gloves-small-ph-891411 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/qba-375-quickblade-auto-load-knife-ph-732163 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/qbd-324-quickblade-blade-dispenser-ph-732205 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/qbd-379-quickblade-blade-dispenser-ph-732203 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/quickblade-retractable-utility-knife-ph-732101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/ranger-trash-can-45-gallon-2-way-beige-ph-748105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/ranger-trash-can-45-gallon-4-way-black-ph-748103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/rb-009-single-edge-blades-ph-732193 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/red-marsh-88-valve-markers-ph-734105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/red-marsh-88fx-metal-paint-markers-ph-734113 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/red-sharpie-magnum-markers-ph-734147 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/red-spring-back-pocket-safety-cutter-ph-732183 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/red-super-sharpie-markers-ph-734135 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/rsc-432-disposable-safety-cutter-ph-732129 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/rsg-194-safety-grip-utility-knife-yellow-ph-732109 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/rsg-197-safety-grip-utility-knife-gray-ph-732113 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/rubber-coated-palm-gloves-extra-large-ph-891433 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/rubber-coated-palm-gloves-large-ph-891429 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/rubbermaid-brute-tandem-dolly-ph-743129 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/rubbermaid-recycling-station-92-gallon-ph-742131 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/rubbermaid-slim-jim-trainable-trolley-ph-742163 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/s5fc-s5-film-cutter-replacement-blades-ph-732209 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/safegrip-glove-w-extended-beaded-cuff-xl-ph-891343 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/safety-cutter-utility-knife-left-handed-ph-732125 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/safety-cutter-utility-knife-right-handed-ph-732121 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/safety-grip-utility-knife-neon-green-ph-732105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/sb-92-standard-utility-blades-ph-732173 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/scott-1-ply-coreless-toliet-tissue-ph-821023 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/scott-2-ply-coreless-bathroom-tissue-ph-821019 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/scott-2-ply-coreless-toliet-tissue-ph-821025 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/scott-blue-shop-towels-on-a-roll-ph-845009 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/scott-blue-shop-towels-pop-up-box-ph-845005 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/scott-blue-shop-towels-pop-up-box-ph-845007 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/scott-coreless-toliet-tissue-dispenser-ph-821039 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/scott-coreless-toliet-tissue-dispenser-ph-821041 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/scott-essential-coreless-toliet-tissue-ph-821021 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/scott-heavy-duty-shop-towels-on-a-roll-ph-845011 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/scott-rags-in-a-box-(2-pack)-ph-845003 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/scott-rags-in-a-box-ph-845001 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/scott-shop-towels-on-a-roll-for-glass-ph-845013 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/scott-surpass-2-ply-bathroom-tissue-ph-821005 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/scrubs-in-a-bucket-hand-cleaner-towels-ph-841101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-black-15-gal-ph-755103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-black-20-30-gal-ph-755105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-black-33-gal-ph-755109 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-black-33-gal-ph-755111 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-black-33-gal-ph-755113 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-black-40-45-gal-ph-755117 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-black-40-45-gal-ph-755119 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-black-44-55-gal-ph-755121 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-black-55-60-gal-ph-755127 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-black-56-gal-ph-755129 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-black-56-gal-ph-755131 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-black-56-gal-ph-755133 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-black-6-bushel-ph-755135 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-black-6-bushel-ph-755137 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-black-6-bushel-ph-755139 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-black-60-gal-ph-755143 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-black-60-gal-ph-755145 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-clear-15-gal-ph-755147 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-clear-20-30-gal-ph-755151 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-clear-33-gal-ph-755153 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-clear-40-45-gal-ph-755155 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-clear-6-bushel-ph-755159 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/second-chance-trash-bag-clear-60-gal-ph-755165 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/securit-retractable-key-holder-2-pack-ph-739101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/sharpie-metallic-marker-silver-ph-734157 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/shop-towels-14-x-14-red-25-lb-box-ph-827037 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/shop-towels-14-x-14-red-5-lb-box-ph-827035 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/shop-towels-natural-25-lb-box-ph-827033 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/shop-towels-natural-5-lb-box-ph-827031 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/single-toliet-tissue-dispenser-black-ph-821031 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/skb-21-8-pt-snap-blades-ph-732189 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/slim-jim-bottle-and-can-recycling-lid-green-ph-742103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/slim-jim-paper-recycling-lid-23-gal-blue-ph-742109 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/slim-jim-paper-recycling-lid-23-gal-green-ph-742111 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/slim-jim-swing-top-lid-23-gallon-beige-ph-742173 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/slim-jim-swing-top-lid-23-gallon-black-ph-742175 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/slim-jim-swing-top-lid-23-gallon-blue-ph-742177 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/slim-jim-swing-top-lid-23-gallon-gray-ph-742179 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/slim-jim-trash-can-23-gallon-beige-ph-742165 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/slim-jim-trash-can-23-gallon-black-ph-742167 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/slim-jim-trash-can-23-gallon-yellow-ph-742171 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/slim-jimrecycling-bottle-and-can-lid-blue-ph-742101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/smoking-area-6-x-9-facility-sign-ph-781139 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/sn-195-standard-utility-knife-ph-732117 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/sn-395-quick-change-knife-ph-732137 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/sp-017-single-notch-safety-blades-ph-732181 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/spd-017-safety-point-blade-dispenser-ph-732201 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/spinner-retractable-key-holder-ph-739109 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/spring-back-safety-cutter-left-handed-ph-732111 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/spring-back-safety-cutter-right-handed-ph-732107 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/sps-92-duratip-safety-utility-blades-ph-732177 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/square-recycling-bottle-and-can-lid-blue-ph-742137 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/square-recycling-bottle-and-can-lid-blue-ph-742143 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/square-recycling-container-23-gal-blue-ph-742139 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/square-recycling-container-35-gal-blue-ph-742145 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/square-recycling-container-50-gal-blue-ph-742147 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/square-recycling-slotted-lid-23-gal-blue-ph-742141 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/stainless-steel-wall-mount-sanitary-receptacle-ph-825003 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/stairs-ada-compliant-plastic-sign-ph-781103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/stop-authorized-personnel-9-x-6-facility-sign-ph-781159 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/string-knit-cotton-gloves-large-ph-891421 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/string-knit-cotton-gloves-small-ph-891419 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/super-48-retractable-key-holder-2-pack-ph-739103 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/sweeping-compound-100-lb-bag-ph-842009 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/sweeping-compound-300-lb-drum-ph-842011 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/swing-top-sanitary-napkin-receptacle-ph-825007 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/t1-tape-splitter-ph-732191 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/telephone-9-x-6-facility-sign-ph-781167 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/telephone-ada-compliant-plastic-sign-ph-781115 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/terry-cloth-towels-white-25-lb-box-ph-827039 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/terry-cloth-towels-white-25-lb-box-ph-827041 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/this-room-is-for-your-convenience-6-x-9-facility-sign-ph-781135 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/toilet-seat-cover-dispenser-chrome-ph-824009 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/toilet-seat-cover-dispenser-smoke-ph-824005 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/toilet-seat-covers-ph-824003 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/tour-guard-v-protective-eyewear-ph-722101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/twin-bathroom-tissue-dispenser-black-ph-821027 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/twin-toliet-tissue-dispenser-steel-ph-821037 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/ukh-325-2-pocket-nylon-holster-ph-732145 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/ukh-326-leather-holster-ph-732149 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/universal-single-knife-nylon-holster-ph-732169 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/urinal-flat-screen-ph-826005 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/vinyl-glove-3-mil-powder-free-s-ph-891355 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/vinyl-glove-3-mil-powdered-m-ph-891349 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/vinyl-gloves-3-mil-powder-free-l-ph-891359 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/vinyl-gloves-3-mil-powder-free-m-ph-891357 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/vinyl-gloves-3-mil-powder-free-xl-ph-891361 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/vinyl-gloves-3-mil-powdered-s-ph-891347 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/vinyl-gloves-3-mil-powdered-xl-ph-891353 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-l-ph-891375 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-l-ph-891391 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-m-ph-891373 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-m-ph-891389 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-s-ph-891387 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-xl-ph-891377 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/vinyl-gloves-5-mil-powdered-l-ph-891367 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/vinyl-gloves-5-mil-powdered-xl-ph-891369 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/virtua-ap-clear-protective-eyewear-ph-722107 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/virtua-clear-temples-protective-eyewear-ph-722105 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wall-mountable-sanitary-napkin-receptacle-ph-825001 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wd-40-11-oz-spray-can-w-smart-straw-ph-845017 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wet-floor-safety-pop-up-cone-3-sided-ph-836003 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wet-floor-sign-2-sided-english-stand-ph-836001 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wheelchair-accessible-ada-compliant-plastic-sign-ph-781101 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/white-marsh-88fx-metal-paint-markers-ph-734115 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/white-mean-streak-paint-in-a-tube-ph-734161 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/white-spring-back-pocket-safety-cutter-ph-732187 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wire-shelving-s-hooks-ph-715393 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wire-shelving-split-sleeves-ph-715395 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wooden-wet-floor-sign-2-sided-ph-836007 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wypall-floor-jumbo-roll-dispenser-ph-843017 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wypall-l-40-all-purpose-wipers-bulk-pack-ph-843021 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wypall-l30-economy-10-x-98-wipers-dispenser-ph-843011 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wypall-l30-economy-164-x-98-wipers-dispenser-ph-843013 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wypall-l40-108-x-10-all-purpose-wipers-ph-843023 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wypall-l40-164-x-98-all-purpose-wipers-ph-843025 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wypall-wall-mount-jumbo-roll-dispenser-ph-843019 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wypall-waterless-cleaning-wipes-ph-843003 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wypall-waterless-cleaning-wipes-ph-843005 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wypall-x60-125-x-168-wipers-dispenser-ph-844005 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wypall-x60-91-x-168-wipers-dispenser-ph-844003 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wypall-x60-industrial-jumbo-roll-wipers-ph-844007 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wypall-x60-wipers-bulk-pack-ph-844001 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wypall-x70-91-x-168-pro-wipers-ph-843041 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wypall-x70-pro-jumbo-roll-wipers-ph-843045 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wypall-x70-pro-wipers-bulk-pack-ph-843039 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wypall-x80-125-x-168-heavy-duty-wipers-ph-843055 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wypall-x80-91-x-168-heavy-duty-wipers-ph-843053 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wypall-x80-red-heavy-duty-wipers-roll-ph-843057 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/wypall-x90-heavy-duty-jumbo-roll-wipers-ph-843069 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/yellow-marsh-88fx-metal-paint-markers-ph-734117 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: URL https://www.packaginghero.com/yellow-mean-streak-paint-in-a-tube-ph-734163 is already flagged as 'DISABLED_NOT_FOUND' in the catalog_urls table.
2025-11-01 09:08:20 [packaging_hero] (PID: 95) INFO: Flagging 2 URLs in the catalog_urls table as 'not found'.
2025-11-01 09:08:21 [packaging_hero] (PID: 95) INFO: Stored 2 URLs in the catalog_urls table as 'not found'.
2025-11-01 09:08:21 [packaging_hero] (PID: 95) WARNING: 1131 URLs were not found in the `catalog_urls` table.
2025-11-01 09:08:21 [packaging_hero] (PID: 95) INFO: URLs not found and not flagged: {'https://www.packaginghero.com/spinner-retractable-key-holder-ph-739109', 'https://www.packaginghero.com/48-x-18-x-54-4-shelf-wire-shelving-ph-715197', 'https://www.packaginghero.com/9-x-12-red-deluxe-job-ticket-holders-ph-731151', 'https://www.packaginghero.com/peltor-optime-98-earmuffs-ph-725119', 'https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-blue-stack-hang-bin-ph-711143', 'https://www.packaginghero.com/60-x-18-x-54-4-shelf-wire-shelving-ph-715229', 'https://www.packaginghero.com/15-3-4-x-7-3-4-stack-hang-dividers-ph-712119', 'https://www.packaginghero.com/latex-industrial-gloves-powder-free-l-ph-891161', 'https://www.packaginghero.com/telephone-ada-compliant-plastic-sign-ph-781115', 'https://www.packaginghero.com/3-x-6-green-waterhog-mat-ph-737193', 'https://www.packaginghero.com/23-5-8-x-6-5-8-x-4-red-shelf-bins-ph-711397', 'https://www.packaginghero.com/6-x-6-charcoal-waterhog-mat-ph-737264', 'https://www.packaginghero.com/slim-jim-swing-top-lid-23-gallon-beige-ph-742173', 'https://www.packaginghero.com/33-x-40-black-can-liners-ph-751159', 'https://www.packaginghero.com/1-1-2-x-60-yds-3m-101+-masking-tape-ph-681635', 'https://www.packaginghero.com/6-x-100ga-2625-poly-olefin-shrink-film-ph-384109', 'https://www.packaginghero.com/wd-40-11-oz-spray-can-w-smart-straw-ph-845017', 'https://www.packaginghero.com/9-x-12-heavyweight-job-ticket-holders-ph-731155', 'https://www.packaginghero.com/6-x-6-medium-gray-waterhog-mat-ph-737266', 'https://www.packaginghero.com/4-x-10-black-yellow-anti-fatigue-mat-ph-737384', 'https://www.packaginghero.com/brute-flat-trash-can-lid-44-gallon-blue-ph-743245', 'https://www.packaginghero.com/11-5-8-x-2-3-4-x-4-blue-shelf-bins-ph-711297', 'https://www.packaginghero.com/4-x-8-medium-gray-waterhog-mat-ph-737242', 'https://www.packaginghero.com/brute-square-can-flat-lid-40-gal-gray-ph-743117', 'https://www.packaginghero.com/brute-trash-can-20-gallon-black-ph-743159', 'https://www.packaginghero.com/3.50-x-1181-black-datamax-thermal-transfer-ribbons-wax-ph-415143', 'https://www.packaginghero.com/16-x-11-x-8-red-stack-hang-bins-ph-711249', 'https://www.packaginghero.com/1-2-cubic-yard-domed-tilt-truck-lid-ph-749103', 'https://www.packaginghero.com/3-x-10-brown-deluxe-entry-mat-ph-737454', 'https://www.packaginghero.com/48-x-12-x-63-wire-shelving-add-on-unit-ph-715187', 'https://www.packaginghero.com/17-x-14-1-2-gray-stack-nest-lids-ph-717149', 'https://www.packaginghero.com/2-x-5-yds-clear-3m-f9473.c-vhb-tape-ph-696179', 'https://www.packaginghero.com/hands-free-trash-can-lid-35-gallon-beige-ph-746105', 'https://www.packaginghero.com/48-x-12-x-54-4-shelf-wire-shelving-ph-715181', 'https://www.packaginghero.com/17-7-8-x-11-1-8-x-4-green-shelf-bins-ph-711375', 'https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-clear-stack-hang-bin-ph-711215', 'https://www.packaginghero.com/4-x-20-brown-waterhog-runner-ph-737293', 'https://www.packaginghero.com/smoking-area-6-x-9-facility-sign-ph-781139', 'https://www.packaginghero.com/48-x-24-wire-shelf-ph-715345', 'https://www.packaginghero.com/20-1-4-x-14-1-4-x-12-3-4-round-trip-tote-ph-717103', 'https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-l-ph-891391', 'https://www.packaginghero.com/17-7-8-x-4-1-8-x-4-yellow-shelf-bins-ph-711351', 'https://www.packaginghero.com/s5fc-s5-film-cutter-replacement-blades-ph-732209', 'https://www.packaginghero.com/16-x-10-x-8-7-8-gray-stack-nest-bin-ph-717113', 'https://www.packaginghero.com/1-4-x-14-trash-can-bands-ph-759103', 'https://www.packaginghero.com/30-x-36-black-can-liners-ph-751151', 'https://www.packaginghero.com/slim-jimrecycling-bottle-and-can-lid-blue-ph-742101', 'https://www.packaginghero.com/3-x-10-burgundy-deluxe-entry-mat-ph-737453', 'https://www.packaginghero.com/12-x-15-job-ticket-holders-ph-731115', 'https://www.packaginghero.com/wypall-x60-91-x-168-wipers-dispenser-ph-844003', 'https://www.packaginghero.com/brute-flat-trash-can-lid-20-gallon-red-ph-743181', 'https://www.packaginghero.com/best-nighthawk-nitrile-gloves-xlarge-ph-891047', 'https://www.packaginghero.com/leather-palm-w-knit-wrist-gloves-l-ph-891307', 'https://www.packaginghero.com/blue-recycling-trash-bag-13-gal-11-mil-ph-757101', 'https://www.packaginghero.com/3-4-x-60-yds-3m-501+-masking-tape-ph-681343', 'https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-yellow-stack-hang-bin-ph-711127', 'https://www.packaginghero.com/6-x-12-charcoal-waterhog-mat-ph-737282', 'https://www.packaginghero.com/brute-trash-can-55-gallon-blue-ph-743259', 'https://www.packaginghero.com/8-shelf-wire-shelving-with-yellow-bins-ph-715115', 'https://www.packaginghero.com/wypall-x60-125-x-168-wipers-dispenser-ph-844005', 'https://www.packaginghero.com/72-x-18-x-84-wire-shelving-add-on-unit-ph-715279', 'https://www.packaginghero.com/1-x-60-yds-3m-501+-masking-tape-ph-681609', 'https://www.packaginghero.com/blue-sharpie-king-size-markers-ph-734137', 'https://www.packaginghero.com/second-chance-trash-bag-black-56-gal-ph-755133', 'https://www.packaginghero.com/wypall-x70-91-x-168-pro-wipers-ph-843041', 'https://www.packaginghero.com/4-x-12-red-black-waterhog-mat-ph-737256', 'https://www.packaginghero.com/door-sign-storage-ph-781179', 'https://www.packaginghero.com/hd-trash-bag-natural-33-gallon-47-mil-ph-754115', 'https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-yellow-stack-hang-bin-ph-711211', 'https://www.packaginghero.com/esd-uncoated-nylon-gloves-large-ph-891073', 'https://www.packaginghero.com/scott-coreless-toliet-tissue-dispenser-ph-821041', 'https://www.packaginghero.com/gojo-cherry-gel-pumice-hand-cleaner-ph-822037', 'https://www.packaginghero.com/39-x-56-sure-sak-can-liners-ph-752107', 'https://www.packaginghero.com/nylon-inspection-gloves-mens-large-ph-891237', 'https://www.packaginghero.com/26-5-8-x-18-1-4-x-14-7-8-blue-stack-nest-bin-ph-717133', 'https://www.packaginghero.com/36-x-12-x-54-4-shelf-wire-shelving-ph-715101', 'https://www.packaginghero.com/3-x-6-charcoal-economy-vinyl-carpet-mat-ph-737520', 'https://www.packaginghero.com/72-x-36-x-74-4-shelf-wire-shelving-ph-715317', 'https://www.packaginghero.com/3-x-5-charcoal-economy-vinyl-carpet-mat-ph-737515', 'https://www.packaginghero.com/3-4-x-60-yds-3m-401+-233+-masking-tape-ph-681451', 'https://www.packaginghero.com/3-x-60-brown-economy-vinyl-carpet-mat-ph-737544', 'https://www.packaginghero.com/13-pt-steel-track-utility-knife-w-grip-ph-732127', 'https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-clear-stack-hang-bin-ph-711103', 'https://www.packaginghero.com/latex-glove-powder-free-w-extended-cuff-xl-ph-891171', 'https://www.packaginghero.com/36-x-58-black-can-liners-ph-751181', 'https://www.packaginghero.com/2-7-8-x-3-plastic-shelf-bin-dividers-ph-712125', 'https://www.packaginghero.com/wypall-wall-mount-jumbo-roll-dispenser-ph-843019', 'https://www.packaginghero.com/16-x-11-x-8-clear-stack-hang-bins-ph-711243', 'https://www.packaginghero.com/17-7-8-x-6-5-8-x-4-red-shelf-bins-ph-711359', 'https://www.packaginghero.com/23-5-8-x-4-1-8-x-4-blue-shelf-bins-ph-711381', 'https://www.packaginghero.com/18-x-11-x-10-red-stack-hang-bins-ph-711277', 'https://www.packaginghero.com/3-x-105-corrugated-rib-runners-ph-737577', 'https://www.packaginghero.com/17-7-8-x-11-1-8-x-4-blue-shelf-bins-ph-711373', 'https://www.packaginghero.com/11-5-8-x-8-3-8-x-4-clear-shelf-bins-ph-711327', 'https://www.packaginghero.com/kimtech-1-ply-44-x-84-precision-low-lint-wipers-ph-844025', 'https://www.packaginghero.com/9-x-16-1-1-2-mil-flat-poly-bag-ph-311695', 'https://www.packaginghero.com/17-7-8-x-8-3-8-x-4-red-shelf-bins-ph-711369', 'https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-s-ph-891387', 'https://www.packaginghero.com/gojo-fast-wipes-ph-846001', 'https://www.packaginghero.com/hd-trash-bag-natural-60-gallon-47-mil-ph-754127', 'https://www.packaginghero.com/7-x-8-4-mil-white-block-reclosable-poly-bag-ph-317165', 'https://www.packaginghero.com/23-5-8-x-8-3-8-4-red-shelf-bins-ph-711407', 'https://www.packaginghero.com/3-x-10-red-black-waterhog-mat-ph-737208', 'https://www.packaginghero.com/sp-017-single-notch-safety-blades-ph-732181', 'https://www.packaginghero.com/vinyl-glove-3-mil-powder-free-s-ph-891355', 'https://www.packaginghero.com/blue-sharpie-fine-point-markers-ph-734119', 'https://www.packaginghero.com/6-shelf-wire-shelving-with-yellow-bins-ph-715131', 'https://www.packaginghero.com/48-x-18-x-86-wire-shelving-add-on-unit-ph-715211', 'https://www.packaginghero.com/blue-sharpie-chisel-tip-markers-ph-734151', 'https://www.packaginghero.com/3-4-x-60-yds-3m-501+-masking-tape-ph-681455', 'https://www.packaginghero.com/clear-poly-gloves-18-elbow-length-ph-891127', 'https://www.packaginghero.com/kimtech-wettask-prep-wipers-ph-844039', 'https://www.packaginghero.com/4-x-8-charcoal-economy-vinyl-carpet-mat-ph-737555', 'https://www.packaginghero.com/deluxe-cowhide-leather-driver-glove-xl-ph-891275', 'https://www.packaginghero.com/contractors-bag-black-30-gallon-30-mil-ph-756101', 'https://www.packaginghero.com/hd-trash-bag-black-33-gallon-86-mil-ph-754143', 'https://www.packaginghero.com/36-x-12-x-74-4-shelf-wire-shelving-ph-715117', 'https://www.packaginghero.com/18-x-16-1-2-x-11-black-conductive-bins-ph-711425', 'https://www.packaginghero.com/4-x-16-black-yellow-anti-fatigue-mat-ph-737390', 'https://www.packaginghero.com/3-x-8-black-yellow-anti-fatigue-mat-ph-737360', 'https://www.packaginghero.com/second-chance-trash-bag-black-44-55-gal-ph-755121', 'https://www.packaginghero.com/rubbermaid-slim-jim-trainable-trolley-ph-742163', 'https://www.packaginghero.com/9-x-12-zippered-job-ticket-holders-ph-731161', 'https://www.packaginghero.com/second-chance-trash-bag-black-60-gal-ph-755145', 'https://www.packaginghero.com/16-x-22-3-mil-flat-poly-bag-ph-311969', 'https://www.packaginghero.com/16-x-10-blue-stack-nest-lids-ph-717139', 'https://www.packaginghero.com/1-1-2-x-60-yds-3m-401+-233+-masking-tape-ph-681663', 'https://www.packaginghero.com/36-x-12-x-54-wire-shelving-add-on-unit-ph-715105', 'https://www.packaginghero.com/latex-industrial-gloves-medium-ph-891149', 'https://www.packaginghero.com/12-1-8-x-9-x-2-1-2-side-loading-mailer-ph-212703', 'https://www.packaginghero.com/8-x-30-4-mil-reclosable-poly-bag-ph-315375', 'https://www.packaginghero.com/fingerless-pvc-dot-knit-gloves-small-ph-891415', 'https://www.packaginghero.com/esd-uncoated-nylon-gloves-small-ph-891069', 'https://www.packaginghero.com/brute-steel-dome-lid-55-gallon-red-ph-743293', 'https://www.packaginghero.com/safegrip-glove-w-extended-beaded-cuff-xl-ph-891343', 'https://www.packaginghero.com/30-x-36-clear-can-liners-ph-751109', 'https://www.packaginghero.com/28-x-18-x-11-gray-brute-totes-with-lid-ph-717163', 'https://www.packaginghero.com/knifehandler-gloves-medium-ph-891063', 'https://www.packaginghero.com/18-x-16-1-2-x-11-black-stack-hang-bin-ph-711289', 'https://www.packaginghero.com/mesh-backed-lifting-gloves-black-x-l-ph-891327', 'https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-m-ph-891389', 'https://www.packaginghero.com/brute-trash-can-10-gallon-blue-ph-743133', 'https://www.packaginghero.com/best-nighthawk-nitrile-gloves-large-ph-891045', 'https://www.packaginghero.com/17-x-14-1-2-x-12-7-8-gray-stack-nest-bin-ph-717125', 'https://www.packaginghero.com/3-x-16-green-waterhog-mat-ph-737217', 'https://www.packaginghero.com/33-x-40-black-can-liners-ph-751163', 'https://www.packaginghero.com/3-4-x-60-yds-3m-860-poly-strapping-tape-ph-643025', 'https://www.packaginghero.com/4-x-6-brown-waterhog-mat-ph-737233', 'https://www.packaginghero.com/4-x-16-red-black-waterhog-mat-ph-737262', 'https://www.packaginghero.com/48-x-24-x-54-wire-shelving-add-on-unit-ph-715215', 'https://www.packaginghero.com/3-x-30-3-mil-flat-poly-bag-ph-311194', 'https://www.packaginghero.com/12-1-8-x-11-5-8-x-2-5-8-side-loading-mailer-ph-212705', 'https://www.packaginghero.com/e-a-r-one-touch-pro-earplug-dispenser-ph-725117', 'https://www.packaginghero.com/20-7-8-x-18-1-4-red-stack-nest-lids-ph-717153', 'https://www.packaginghero.com/wypall-l30-economy-164-x-98-wipers-dispenser-ph-843013', 'https://www.packaginghero.com/slim-jim-paper-recycling-lid-23-gal-green-ph-742111', 'https://www.packaginghero.com/11-5-8-x-4-1-8-x-4-red-shelf-bins-ph-711309', 'https://www.packaginghero.com/gritless-sweeping-compound-100-lb-bag-ph-842005', 'https://www.packaginghero.com/wire-shelving-split-sleeves-ph-715395', 'https://www.packaginghero.com/fluorescent-green-sharpie-highlighters-ph-734165', 'https://www.packaginghero.com/5-1-8-x-2-3-4-x-3-blue-shelf-bin-cups-ph-713105', 'https://www.packaginghero.com/brute-domed-trash-can-lid-44-gal-blue-ph-743237', 'https://www.packaginghero.com/12-wide-seal-foot-operated-impulse-sealer-ph-344127', 'https://www.packaginghero.com/brute-trash-can-44-gallon-green-ph-743227', 'https://www.packaginghero.com/brute-trash-can-55-gallon-white-ph-743267', 'https://www.packaginghero.com/3-x-15-gray-economy-anti-fatigue-mat-ph-737373', 'https://www.packaginghero.com/18-x-16-1-2-x-11-yellow-stack-hang-bin-ph-711295', 'https://www.packaginghero.com/3.14-x-1476-black-zebra-thermal-transfer-ribbons-wax-ph-415129', 'https://www.packaginghero.com/brute-square-trash-can-28-gallon-red-ph-743103', 'https://www.packaginghero.com/wypall-x90-heavy-duty-jumbo-roll-wipers-ph-843069', 'https://www.packaginghero.com/scott-surpass-2-ply-bathroom-tissue-ph-821005', 'https://www.packaginghero.com/6-x-10-medium-gray-waterhog-mat-ph-737278', 'https://www.packaginghero.com/red-spring-back-pocket-safety-cutter-ph-732183', 'https://www.packaginghero.com/40-x-40-3-mil-flat-poly-bag-ph-312467', 'https://www.packaginghero.com/3-x-16-brown-waterhog-mat-ph-737215', 'https://www.packaginghero.com/brute-trash-can-20-gallon-white-ph-743169', 'https://www.packaginghero.com/48-x-18-wire-shelf-ph-715341', 'https://www.packaginghero.com/9-x-12-x-1-gusseted-job-ticket-holders-ph-731147', 'https://www.packaginghero.com/4-x-6-job-ticket-holders-ph-731101', 'https://www.packaginghero.com/brute-flat-trash-can-lid-55-gal-yellow-ph-743287', 'https://www.packaginghero.com/second-chance-trash-bag-black-40-45-gal-ph-755117', 'https://www.packaginghero.com/4-x-4-navy-waterhog-mat-ph-737225', 'https://www.packaginghero.com/cotton-inspection-ext-cuff-glove-l-ph-891231', 'https://www.packaginghero.com/door-sign-employees-only-ph-781185', 'https://www.packaginghero.com/fire-alarm-9-x-6-facility-sign-ph-781155', 'https://www.packaginghero.com/liners-for-sanitary-napkin-receptacles-ph-825005', 'https://www.packaginghero.com/nitrile-gloves-with-beaded-cuff-medium-ph-891221', 'https://www.packaginghero.com/deluxe-urinal-screen-spiced-apple-ph-826011', 'https://www.packaginghero.com/25-3-4-x-16-x-12-1-2-round-trip-tote-ph-717105', 'https://www.packaginghero.com/3-x-9-slip-guard-drainage-mat-ph-737151', 'https://www.packaginghero.com/28-x-18-x-15-white-brute-totes-w-lid-ph-717169', 'https://www.packaginghero.com/3-x-9-black-yellow-anti-fatigue-mat-ph-737363', 'https://www.packaginghero.com/gritless-sweeping-compound-200-lb-bag-ph-842007', 'https://www.packaginghero.com/3-x-10-black-economy-anti-fatigue-mat-ph-737365', 'https://www.packaginghero.com/vinyl-gloves-3-mil-powder-free-m-ph-891357', 'https://www.packaginghero.com/17-7-8-x-6-5-8-x-4-clear-shelf-bins-ph-711355', 'https://www.packaginghero.com/40-x-46-black-can-liners-ph-751179', 'https://www.packaginghero.com/72-x-36-wire-shelves-2-pack-ph-715371', 'https://www.packaginghero.com/hd-trash-bag-black-56-gallon-55-mil-ph-754151', 'https://www.packaginghero.com/door-sign-watch-your-step-ph-781201', 'https://www.packaginghero.com/sweeping-compound-100-lb-bag-ph-842009', 'https://www.packaginghero.com/cotton-inspection-gloves-35-oz-small-ph-891233', 'https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-blue-stack-hang-bin-ph-711199', 'https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-ivory-stack-hang-bin-ph-711223', 'https://www.packaginghero.com/36-x-19-wall-mounted-panel-rack-ph-714105', 'https://www.packaginghero.com/scott-essential-coreless-toliet-tissue-ph-821021', 'https://www.packaginghero.com/continuous-air-freshener-refill-mango-ph-827013', 'https://www.packaginghero.com/36-x-24-x-54-4-shelf-wire-shelving-ph-715165', 'https://www.packaginghero.com/2-x-55-yds-tan-400-industrial-tape-ph-612183', 'https://www.packaginghero.com/3m-8200-dust-respirator-ph-723113', 'https://www.packaginghero.com/auto-retracting-swivel-holster-ph-732157', 'https://www.packaginghero.com/11-5-8-x-6-5-8-x-4-yellow-shelf-bins-ph-711323', 'https://www.packaginghero.com/11-5-8-x-6-5-8-x-4-blue-shelf-bins-ph-711315', 'https://www.packaginghero.com/17-x-14-1-2-red-stack-nest-lids-ph-717147', 'https://www.packaginghero.com/second-chance-trash-bag-black-20-30-gal-ph-755105', 'https://www.packaginghero.com/2-x-60-yds-3m-501+-masking-tape-ph-681753', 'https://www.packaginghero.com/8-1-2-x-11-job-ticket-holders-ph-731107', 'https://www.packaginghero.com/red-super-sharpie-markers-ph-734135', 'https://www.packaginghero.com/2-x-10-black-marble-anti-fatigue-mat-ph-737122', 'https://www.packaginghero.com/2-x-4-4-mil-white-block-reclosable-poly-bag-ph-317289', 'https://www.packaginghero.com/emergency-exit-only-6-x-9-facility-sign-ph-781119', 'https://www.packaginghero.com/glad-drawstring-trash-bag-30-gal-black-ph-753103', 'https://www.packaginghero.com/18-x-8-1-4-x-9-red-stack-hang-bins-ph-711263', 'https://www.packaginghero.com/18-x-13-x-6-blue-space-age-totes-ph-716103', 'https://www.packaginghero.com/hands-free-trash-can-lid-35-gallon-gray-ph-746107', 'https://www.packaginghero.com/wypall-x60-industrial-jumbo-roll-wipers-ph-844007', 'https://www.packaginghero.com/12-x-15-1-2-poly-mailers-without-tear-strip-ph-221215', 'https://www.packaginghero.com/2-x-8-black-premium-anti-fatigue-mat-ph-737410', 'https://www.packaginghero.com/bkb-18-13-pt-snap-blades-ph-732185', 'https://www.packaginghero.com/63-chrome-poles-4-pack-ph-715379', 'https://www.packaginghero.com/4-x-10-medium-gray-waterhog-mat-ph-737248', 'https://www.packaginghero.com/manual-liquid-soap-dispenser-ph-821051', 'https://www.packaginghero.com/17-7-8-x-8-3-8-x-4-clear-shelf-bins-ph-711365', 'https://www.packaginghero.com/4-x-16-navy-waterhog-mat-ph-737261', 'https://www.packaginghero.com/e-a-r-earmuffs-ph-725121', 'https://www.packaginghero.com/48-x-12-x-86-4-shelf-wire-shelving-ph-715193', 'https://www.packaginghero.com/hd-trash-bag-natural-12-15-gal-31-mil-ph-754107', 'https://www.packaginghero.com/marshal-domed-trash-can-25-gallon-beige-ph-745103', 'https://www.packaginghero.com/3.15-x-984-black-zebra-thermal-transfer-ribbons-ph-415135', 'https://www.packaginghero.com/slim-jim-swing-top-lid-23-gallon-blue-ph-742177', 'https://www.packaginghero.com/ice-melt-ph-843001', 'https://www.packaginghero.com/4-x-6-red-black-waterhog-mat-ph-737238', 'https://www.packaginghero.com/16-x-10-x-8-7-8-blue-stack-nest-bin-ph-717109', 'https://www.packaginghero.com/11-5-8-x-2-3-4-x-4-red-shelf-bins-ph-711301', 'https://www.packaginghero.com/1-1-2-x-60-yds-8-pack-3m-401+-233+-masking-tape-ph-681637', 'https://www.packaginghero.com/virtua-clear-temples-protective-eyewear-ph-722105', 'https://www.packaginghero.com/11-5-8-x-11-1-8-x-4-yellow-shelf-bins-ph-711341', 'https://www.packaginghero.com/latex-industrial-gloves-large-ph-891151', 'https://www.packaginghero.com/6-shelf-wire-shelving-with-green-bins-ph-715139', 'https://www.packaginghero.com/knifehandler-gloves-extra-large-ph-891067', 'https://www.packaginghero.com/3-x-15-blue-marble-anti-fatigue-mat-ph-737141', 'https://www.packaginghero.com/20-7-8-x-18-1-4-x-9-7-8-red-stack-nest-bin-ph-717129', 'https://www.packaginghero.com/6-x-16-brown-waterhog-mat-ph-737287', 'https://www.packaginghero.com/18-x-22-1-1-2-mil-flat-poly-bag-ph-311946', 'https://www.packaginghero.com/36-x-58-clear-can-liners-ph-751131', 'https://www.packaginghero.com/23-5-8-x-8-3-8-x-4-clear-shelf-bins-ph-711403', 'https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-yellow-stack-hang-bin-ph-711239', 'https://www.packaginghero.com/hd-trash-bag-natural-56-gallon-67-mil-ph-754123', 'https://www.packaginghero.com/brute-trash-can-44-gallon-blue-ph-743225', 'https://www.packaginghero.com/second-chance-trash-bag-black-6-bushel-ph-755139', 'https://www.packaginghero.com/qbd-324-quickblade-blade-dispenser-ph-732205', 'https://www.packaginghero.com/9-x-12-job-ticket-holders-with-strap-ph-731145', 'https://www.packaginghero.com/3-x-20-green-waterhog-runner-ph-737307', 'https://www.packaginghero.com/9-1-4-x-6-x-5-red-stack-hang-bins-ph-711137', 'https://www.packaginghero.com/48-x-24-x-54-4-shelf-wire-shelving-ph-715213', 'https://www.packaginghero.com/shop-towels-natural-5-lb-box-ph-827031', 'https://www.packaginghero.com/brute-trash-can-10-gallon-black-ph-743131', 'https://www.packaginghero.com/hd-trash-bag-black-6-bushel-67-mil-ph-754157', 'https://www.packaginghero.com/hd-trash-bag-natural-7-10-gallon-31-mil-ph-754103', 'https://www.packaginghero.com/wypall-l-40-all-purpose-wipers-bulk-pack-ph-843021', 'https://www.packaginghero.com/2-x-16-black-economy-anti-fatigue-mat-ph-737341', 'https://www.packaginghero.com/square-recycling-bottle-and-can-lid-blue-ph-742137', 'https://www.packaginghero.com/string-knit-cotton-gloves-large-ph-891421', 'https://www.packaginghero.com/4-x-20-navy-waterhog-runner-ph-737297', 'https://www.packaginghero.com/17-7-8-x-4-1-8-x-4-green-shelf-bins-ph-711347', 'https://www.packaginghero.com/3-x-16-medium-gray-waterhog-mat-ph-737218', 'https://www.packaginghero.com/4-x-20-charcoal-waterhog-runner-ph-737294', 'https://www.packaginghero.com/ranger-trash-can-45-gallon-2-way-beige-ph-748105', 'https://www.packaginghero.com/60-x-18-wire-shelves-2-pack-ph-715351', 'https://www.packaginghero.com/scott-blue-shop-towels-pop-up-box-ph-845005', 'https://www.packaginghero.com/environsweep-100-lb-ph-842001', 'https://www.packaginghero.com/4-x-20-medium-gray-waterhog-runner-ph-737296', 'https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-clear-stack-hang-bin-ph-711117', 'https://www.packaginghero.com/3-x-12-medium-gray-waterhog-mat-ph-737212', 'https://www.packaginghero.com/23-5-8-x-6-5-8-x-4-blue-shelf-bins-ph-711391', 'https://www.packaginghero.com/23-x-15-x-16-blue-space-age-totes-ph-716115', 'https://www.packaginghero.com/2-x-60-yds-3m-2515-flatback-tape-ph-624081', 'https://www.packaginghero.com/10-1-2-x-16-kraft-5-padded-mailers-ph-251155', 'https://www.packaginghero.com/3-x-8-green-waterhog-mat-ph-737199', 'https://www.packaginghero.com/6-x-10-brown-waterhog-mat-ph-737275', 'https://www.packaginghero.com/gojo-nxt-maximum-capacity-dispenser-ph-846009', 'https://www.packaginghero.com/9-1-4-x-6-x-5-black-stack-hang-bins-ph-711135', 'https://www.packaginghero.com/wypall-x80-91-x-168-heavy-duty-wipers-ph-843053', 'https://www.packaginghero.com/23-5-8-x-11-1-8-x-4-blue-shelf-bins-ph-711411', 'https://www.packaginghero.com/all-purpose-first-aid-kit-25-person-ph-724101', 'https://www.packaginghero.com/6-x-12-navy-waterhog-mat-ph-737285', 'https://www.packaginghero.com/72-x-24-x-74-4-shelf-wire-shelving-ph-715301', 'https://www.packaginghero.com/6-x-20-medium-gray-waterhog-runner-ph-737302', 'https://www.packaginghero.com/16-x-11-x-8-black-stack-hang-bins-ph-711247', 'https://www.packaginghero.com/dixie-paper-plates-10-1-4-heavyweight-ph-882101', 'https://www.packaginghero.com/1-1-2-x-60-yds-3m-201+-masking-tape-ph-681611', 'https://www.packaginghero.com/contractors-bag-black-56-gal-30-mil-ph-756109', 'https://www.packaginghero.com/23-5-8-x-4-1-8-x-4-green-shelf-bins-ph-711385', 'https://www.packaginghero.com/72-x-24-wire-shelf-2-pack-ph-715365', 'https://www.packaginghero.com/36-x-12-1-2-x-66-floor-rack-bin-organizer-ph-714109', 'https://www.packaginghero.com/3-x-60-blue-economy-vinyl-carpet-mat-ph-737543', 'https://www.packaginghero.com/nitrile-gloves-6-mil-xlarge-ph-891195', 'https://www.packaginghero.com/glad-forceflex-trash-bag-13-gal-white-ph-753105', 'https://www.packaginghero.com/exit-6-x-9-facility-sign-ph-781121', 'https://www.packaginghero.com/blade-bank-ph-732207', 'https://www.packaginghero.com/3-x-10-brown-waterhog-mat-ph-737203', 'https://www.packaginghero.com/4-5-8-x-2-13-16-stack-hang-dividers-ph-712101', 'https://www.packaginghero.com/12-1-8-x-9-1-4-x-5-kraft-deluxe-literature-mailer-ph-212213', 'https://www.packaginghero.com/9-x-12-dual-pocket-job-ticket-holders-ph-731149', 'https://www.packaginghero.com/e-a-r-classic-earplugs-refill-ph-725113', 'https://www.packaginghero.com/3-x-8-premium-anti-fatigue-mat-ph-737429', 'https://www.packaginghero.com/13-x-16-3-mil-flat-poly-bag-ph-311957', 'https://www.packaginghero.com/1-1-2-x-60-yds-3m-301+-masking-tape-ph-681631', 'https://www.packaginghero.com/18-wide-seal-foot-operated-impulse-sealer-ph-344147', 'https://www.packaginghero.com/blue-recycling-trash-bag-13-gal-15-mil-ph-757103', 'https://www.packaginghero.com/33-x-40-black-can-liners-ph-751157', 'https://www.packaginghero.com/36-x-24-x-12-corrugated-boxes-ph-103605', 'https://www.packaginghero.com/shop-towels-14-x-14-red-25-lb-box-ph-827037', 'https://www.packaginghero.com/2-x-110-yds-clear-3m-3199-security-tape-ph-616041', 'https://www.packaginghero.com/3-x-12-black-yellow-anti-fatigue-mat-ph-737369', 'https://www.packaginghero.com/scott-2-ply-coreless-toliet-tissue-ph-821025', 'https://www.packaginghero.com/11-x-14-solid-back-job-ticket-holders-ph-731135', 'https://www.packaginghero.com/4-x-4-green-waterhog-mat-ph-737223', 'https://www.packaginghero.com/11-5-8-x-11-1-8-x-4-green-shelf-bins-ph-711337', 'https://www.packaginghero.com/brute-square-trash-can-40-gallon-gray-ph-743113', 'https://www.packaginghero.com/ez4-guarded-spring-back-safety-cutter-ph-732103', 'https://www.packaginghero.com/door-sign-manager-ph-781175', 'https://www.packaginghero.com/mesh-fingerless-glove-w-wrist-strap-m-ph-891103', 'https://www.packaginghero.com/33-x-40-black-can-liners-ph-751155', 'https://www.packaginghero.com/red-marsh-88fx-metal-paint-markers-ph-734113', 'https://www.packaginghero.com/men-women-accessible-ada-compliant-plastic-sign-ph-781117', 'https://www.packaginghero.com/18-x-13-x-6-white-space-age-totes-ph-716101', 'https://www.packaginghero.com/angel-soft-toliet-tissue-dispenser-pack-ph-824001', 'https://www.packaginghero.com/17-7-8-x-4-1-8-x-4-red-shelf-bins-ph-711349', 'https://www.packaginghero.com/nitrile-gloves-4-mil-xlarge-ph-891187', 'https://www.packaginghero.com/48-x-24-wire-shelves-4-pack-ph-715347', 'https://www.packaginghero.com/36-x-18-x-74-wire-shelving-add-on-unit-ph-715153', 'https://www.packaginghero.com/kleenex-boutique-facial-tissue-ph-881000', 'https://www.packaginghero.com/best-7500-nitrile-gloves-xlarge-ph-891135', 'https://www.packaginghero.com/4-x-12-6-mil-reclosable-poly-bag-ph-315377', 'https://www.packaginghero.com/fluorescent-yellow-sharpie-highlighters-ph-734169', 'https://www.packaginghero.com/1-1-2-x-60-yds-3m-301+-masking-tape-ph-681661', 'https://www.packaginghero.com/yellow-mean-streak-paint-in-a-tube-ph-734163', 'https://www.packaginghero.com/6-x-9-job-ticket-holders-ph-731105', 'https://www.packaginghero.com/60-x-18-x-63-4-shelf-wire-shelving-ph-715233', 'https://www.packaginghero.com/3-x-60-forest-green-vinyl-carpet-mat-ph-737546', 'https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-blue-stack-hang-bin-ph-711227', 'https://www.packaginghero.com/22-1-2-x-24-1-2-black-can-liners-ph-751141', 'https://www.packaginghero.com/blue-spring-back-pocket-safety-cutter-ph-732179', 'https://www.packaginghero.com/36-x-18-wire-shelf-ph-715329', 'https://www.packaginghero.com/4-x-16-green-waterhog-mat-ph-737259', 'https://www.packaginghero.com/18-x-13-x-12-blue-space-age-totes-ph-716109', 'https://www.packaginghero.com/box-of-rags-premium-white-10-lb-box-ph-827025', 'https://www.packaginghero.com/vinyl-gloves-3-mil-powder-free-xl-ph-891361', 'https://www.packaginghero.com/16-x-11-x-8-blue-stack-hang-bins-ph-711241', 'https://www.packaginghero.com/3-x-8-black-premium-anti-fatigue-mat-ph-737428', 'https://www.packaginghero.com/1-1-2-x-60-yds-3m-501+-masking-tape-ph-681633', 'https://www.packaginghero.com/gojo-fast-wipes-(1-pack)-ph-846003', 'https://www.packaginghero.com/48-x-18-wire-shelves-ph-715343', 'https://www.packaginghero.com/20-7-8-x-18-1-4-x-9-7-8-gray-stack-nest-bin-ph-717131', 'https://www.packaginghero.com/2-x-8-premium-anti-fatigue-mat-ph-737411', 'https://www.packaginghero.com/e-a-rsoft-yellow-neons-earplugs-refill-ph-725115', 'https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-blue-stack-hang-bin-ph-711157', 'https://www.packaginghero.com/4-x-8-brown-waterhog-mat-ph-737239', 'https://www.packaginghero.com/11-x-14-job-ticket-holders-ph-731111', 'https://www.packaginghero.com/box-of-rags-standard-10-lb-box-ph-827019', 'https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-black-conductive-bin-ph-711421', 'https://www.packaginghero.com/esd-fingertip-coated-nylon-gloves-l-ph-891079', 'https://www.packaginghero.com/spring-back-safety-cutter-left-handed-ph-732111', 'https://www.packaginghero.com/11-5-8-x-2-3-4-x-4-yellow-shelf-bins-ph-711303', 'https://www.packaginghero.com/vinyl-gloves-3-mil-powder-free-l-ph-891359', 'https://www.packaginghero.com/kleenex-cottonelle-2-ply-bathroom-tissue-ph-821007', 'https://www.packaginghero.com/13-pt-steel-track-snap-utility-knife-ph-732131', 'https://www.packaginghero.com/3-x-16-premium-anti-fatigue-mat-ph-737435', 'https://www.packaginghero.com/100-jersey-cotton-gloves-large-ph-891425', 'https://www.packaginghero.com/hands-free-trash-can-23-gallon-beige-ph-746109', 'https://www.packaginghero.com/hd-trash-bag-black-56-gallon-67-mil-ph-754153', 'https://www.packaginghero.com/48-x-18-x-74-4-shelf-wire-shelving-ph-715205', 'https://www.packaginghero.com/second-chance-trash-bag-black-40-45-gal-ph-755119', 'https://www.packaginghero.com/gojo-cherry-gel-pumice-hand-cleaner-ph-822021', 'https://www.packaginghero.com/1-x-60-yds-3m-9485.c-adhesive-transfer-tape-ph-651061', 'https://www.packaginghero.com/18-x-13-x-6-red-space-age-totes-ph-716105', 'https://www.packaginghero.com/2.52-x-1181-black-datamax-thermal-transfer-ribbons-wax-ph-415119', 'https://www.packaginghero.com/exam-grade-latex-gloves-powder-free-l-ph-891143', 'https://www.packaginghero.com/5-shelf-wire-shelving-with-blue-bins-ph-715151', 'https://www.packaginghero.com/23-x-33-black-can-liners-ph-751145', 'https://www.packaginghero.com/6-x-75ga-x-3500-poly-olefin-shrink-film-ph-384105', 'https://www.packaginghero.com/3-x-12-hog-heaven-nitrile-mats-ph-737570', 'https://www.packaginghero.com/lined-jersey-cotton-gloves-large-ph-891427', 'https://www.packaginghero.com/10-x-30-4-mil-reclosable-poly-bag-ph-315447', 'https://www.packaginghero.com/5-x-24-2-mil-reclosable-poly-bag-ph-315321', 'https://www.packaginghero.com/4-x-6-green-waterhog-mat-ph-737235', 'https://www.packaginghero.com/18-x-8-1-4-x-9-green-stack-hang-bins-ph-711259', 'https://www.packaginghero.com/1-x-60-yds-13m-101+-masking-tape-ph-681471', 'https://www.packaginghero.com/3-x-5-charcoal-deluxe-vinyl-carpet-mat-ph-737465', 'https://www.packaginghero.com/wypall-waterless-cleaning-wipes-ph-843003', 'https://www.packaginghero.com/9-x-12-4-mil-minigrip-anti-static-reclosable-poly-bag-ph-313259', 'https://www.packaginghero.com/3-x-20-navy-waterhog-runner-ph-737309', 'https://www.packaginghero.com/30-x-36-black-can-liners-ph-751149', 'https://www.packaginghero.com/best-nighthawk-nitrile-gloves-small-ph-891041', 'https://www.packaginghero.com/red-marsh-88-valve-markers-ph-734105', 'https://www.packaginghero.com/premium-safety-cutter-ambidextrous-ph-732167', 'https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-black-stack-hang-bin-ph-711219', 'https://www.packaginghero.com/33-x-39-clear-can-liners-ph-751113', 'https://www.packaginghero.com/2-x-5-black-premium-anti-fatigue-mat-ph-737406', 'https://www.packaginghero.com/6-x-10-charcoal-waterhog-mat-ph-737276', 'https://www.packaginghero.com/48-x-24-x-74-4-shelf-wire-shelving-ph-715221', 'https://www.packaginghero.com/brute-flat-trash-can-lid-44-gallon-gray-ph-743249', 'https://www.packaginghero.com/18-x-11-x-10-yellow-stack-hang-bins-ph-711281', 'https://www.packaginghero.com/wypall-x70-pro-jumbo-roll-wipers-ph-843045', 'https://www.packaginghero.com/3-x-20-red-black-waterhog-runner-ph-737310', 'https://www.packaginghero.com/hd-trash-bag-natural-33-gallon-67-mil-ph-754117', 'https://www.packaginghero.com/6-x-8-4-mil-minigrip-anti-static-reclosable-poly-bag-ph-313217', 'https://www.packaginghero.com/3-x-16-red-black-waterhog-mat-ph-737220', 'https://www.packaginghero.com/nitrile-gloves-4-mil-medium-ph-891183', 'https://www.packaginghero.com/brute-flat-trash-can-lid-44-gal-green-ph-743247', 'https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-ivory-stack-hang-bin-ph-711181', 'https://www.packaginghero.com/tour-guard-v-protective-eyewear-ph-722101', 'https://www.packaginghero.com/3-4-x-60-yds-3m-301+-masking-tape-ph-681335', 'https://www.packaginghero.com/3m-6300-half-face-respirator-large-ph-723111', 'https://www.packaginghero.com/brute-trash-can-20-gallon-gray-ph-743165', 'https://www.packaginghero.com/spring-back-safety-cutter-right-handed-ph-732107', 'https://www.packaginghero.com/esd-palm-coated-nylon-gloves-small-ph-891081', 'https://www.packaginghero.com/2-x-110-yds-caution-if-seal-is-broke-printed-tape-ph-617005', 'https://www.packaginghero.com/74-chrome-poles-4-pack-ph-715383', 'https://www.packaginghero.com/11-5-8-x-4-1-8-x-4-blue-shelf-bins-ph-711305', 'https://www.packaginghero.com/11-5-8-x-11-1-8-x-4-blue-shelf-bins-ph-711335', 'https://www.packaginghero.com/11-5-8-x-6-5-8-x-4-clear-shelf-bins-ph-711317', 'https://www.packaginghero.com/latex-industrial-gloves-xlarge-ph-891153', 'https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-black-stack-hang-bin-ph-711107', 'https://www.packaginghero.com/3-4-x-60-yds-3m-301+-masking-tape-ph-681447', 'https://www.packaginghero.com/bedford-2-ply-toilet-tissue-ph-821003', 'https://www.packaginghero.com/72-x-18-x-74-4-shelf-wire-shelving-ph-715285', 'https://www.packaginghero.com/9-x-12-neon-orange-job-ticket-holders-ph-731125', 'https://www.packaginghero.com/17-x-14-1-2-x-12-7-8-red-stack-nest-bin-ph-717123', 'https://www.packaginghero.com/2-x-60-gray-economy-anti-fatigue-mat-ph-737349', 'https://www.packaginghero.com/terry-cloth-towels-white-25-lb-box-ph-827041', 'https://www.packaginghero.com/1-1-2-x-60-yds-3m-101+-masking-tape-ph-681639', 'https://www.packaginghero.com/10-1-8-x-3-3-4-stack-hang-dividers-ph-712111', 'https://www.packaginghero.com/nylon-inspection-glove-mens-xl-ph-891239', 'https://www.packaginghero.com/skb-21-8-pt-snap-blades-ph-732189', 'https://www.packaginghero.com/36-x-12-wire-shelves-ph-715327', 'https://www.packaginghero.com/16-x-10-gray-stack-nest-lids-ph-717143', 'https://www.packaginghero.com/4-x-6-blue-marble-anti-fatigue-mat-ph-737145', 'https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-l-ph-891375', 'https://www.packaginghero.com/scott-heavy-duty-shop-towels-on-a-roll-ph-845011', 'https://www.packaginghero.com/23-5-8-x-8-3-8-x-4-yellow-shelf-bins-ph-711409', 'https://www.packaginghero.com/11-5-8-x-4-1-8-x-4-yellow-shelf-bins-ph-711311', 'https://www.packaginghero.com/24-x-31-clear-can-liners-ph-751105', 'https://www.packaginghero.com/4-x-6-brown-waterhog-elite-mat-ph-737402', 'https://www.packaginghero.com/goatskin-leather-drivers-gloves-medium-ph-891277', 'https://www.packaginghero.com/5-1-4-x-3-plastic-shelf-bin-dividers-ph-712127', 'https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-ivory-stack-hang-bin-ph-711209', 'https://www.packaginghero.com/6-shelf-wire-shelving-with-yellow-bins-ph-715147', 'https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-clear-stack-hang-bin-ph-711159', 'https://www.packaginghero.com/16-x-10-red-stack-nest-lids-ph-717141', 'https://www.packaginghero.com/3-x-5-slip-guard-drainage-mat-ph-737150', 'https://www.packaginghero.com/hd-trash-bag-black-60-gallon-67-mil-ph-754161', 'https://www.packaginghero.com/6-x-9-red-job-ticket-holders-ph-731119', 'https://www.packaginghero.com/marshal-domed-trash-can-25-gallon-black-ph-745105', 'https://www.packaginghero.com/3-x-5-charcoal-deluxe-entry-mat-ph-737452', 'https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-red-stack-hang-bin-ph-711221', 'https://www.packaginghero.com/3m-6003-reusable-respirator-ph-723107', 'https://www.packaginghero.com/brute-square-can-flat-lid-40-gal-white-ph-743119', 'https://www.packaginghero.com/38-x-48-3-mil-flat-poly-bag-ph-312395', 'https://www.packaginghero.com/3-x-10-black-yellow-anti-fatigue-mat-ph-737366', 'https://www.packaginghero.com/72-x-36-x-63-4-shelf-wire-shelving-ph-715313', 'https://www.packaginghero.com/stairs-ada-compliant-plastic-sign-ph-781103', 'https://www.packaginghero.com/18-x-16-1-2-x-11-blue-stack-hang-bins-ph-711283', 'https://www.packaginghero.com/48-x-18-x-63-4-shelf-wire-shelving-ph-715201', 'https://www.packaginghero.com/60-x-24-x-74-wire-shelving-add-on-unit-ph-715255', 'https://www.packaginghero.com/brute-square-trash-can-28-gallon-gray-ph-743101', 'https://www.packaginghero.com/brute-square-can-flat-lid-28-gal-gray-ph-743107', 'https://www.packaginghero.com/2-x-55-yds-fragile-box-printed-box-tape-ph-617099', 'https://www.packaginghero.com/15-x-11-1-8-x-6-kraft-easy-fold-mailers-ph-211799', 'https://www.packaginghero.com/17-x-14-1-2-x-12-7-8-blue-stack-nest-bin-ph-717121', 'https://www.packaginghero.com/48-x-12-x-54-wire-shelving-add-on-unit-ph-715183', 'https://www.packaginghero.com/4-x-10-black-premium-anti-fatigue-mat-ph-737444', 'https://www.packaginghero.com/5-shelf-wire-shelving-with-red-bins-ph-715159', 'https://www.packaginghero.com/scott-shop-towels-on-a-roll-for-glass-ph-845013', 'https://www.packaginghero.com/3-x-60-yds-3m-401+-233+-masking-tape-ph-681791', 'https://www.packaginghero.com/vinyl-gloves-3-mil-powdered-s-ph-891347', 'https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-xl-ph-891377', 'https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-ivory-stack-hang-bin-ph-711237', 'https://www.packaginghero.com/2-x-60-yds-3m-2460-flatback-tape-ph-624069', 'https://www.packaginghero.com/5-1-2-x-10-red-border-airbill-envelope-document-envelope-ph-459005', 'https://www.packaginghero.com/6-x-20-green-waterhog-runner-ph-737301', 'https://www.packaginghero.com/handguard-ii-gloves-large-ph-891059', 'https://www.packaginghero.com/33-x-40-black-can-liners-ph-751161', 'https://www.packaginghero.com/stop-authorized-personnel-9-x-6-facility-sign-ph-781159', 'https://www.packaginghero.com/heavy-duty-original-keybak-key-holder-ph-739107', 'https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-green-stack-hang-bin-ph-711231', 'https://www.packaginghero.com/48-x-18-x-86-4-shelf-wire-shelving-ph-715209', 'https://www.packaginghero.com/nitrile-gloves-exam-grade-medium-ph-891175', 'https://www.packaginghero.com/6-5-8-x-2-3-4-stack-hang-bin-dividers-ph-712105', 'https://www.packaginghero.com/11-x-17-job-ticket-holders-ph-731113', 'https://www.packaginghero.com/universal-single-knife-nylon-holster-ph-732169', 'https://www.packaginghero.com/60-x-36-x-74-4-shelf-wire-shelving-ph-715269', 'https://www.packaginghero.com/1-4-x-17-trash-can-bands-ph-759105', 'https://www.packaginghero.com/safety-grip-utility-knife-neon-green-ph-732105', 'https://www.packaginghero.com/72-x-18-wire-shelf-ph-715361', 'https://www.packaginghero.com/2-x-60-yds-3m-201+-masking-tape-ph-681707', 'https://www.packaginghero.com/black-sharpie-king-size-markers-ph-734139', 'https://www.packaginghero.com/charmin-2-ply-bathroom-tissue-ph-821009', 'https://www.packaginghero.com/18-x-16-1-2-x-11-green-stack-hang-bin-ph-711287', 'https://www.packaginghero.com/slim-jim-paper-recycling-lid-23-gal-blue-ph-742109', 'https://www.packaginghero.com/33-x-39-clear-can-liners-ph-751117', 'https://www.packaginghero.com/6-x-10-green-waterhog-mat-ph-737277', 'https://www.packaginghero.com/second-chance-trash-bag-black-33-gal-ph-755109', 'https://www.packaginghero.com/9-x-12-solid-back-job-ticket-holders-ph-731141', 'https://www.packaginghero.com/hd-trash-bag-natural-60-gallon-86-mil-ph-754133', 'https://www.packaginghero.com/17-x-9-3-4-stack-hang-bin-dividers-ph-712121', 'https://www.packaginghero.com/17-x-14-1-2-blue-stack-nest-lids-ph-717145', 'https://www.packaginghero.com/wypall-l40-164-x-98-all-purpose-wipers-ph-843025', 'https://www.packaginghero.com/5-1-8-x-2-3-4-x-3-yellow-shelf-bin-cups-ph-713107', 'https://www.packaginghero.com/office-recycling-container-3-gallon-blue-ph-742133', 'https://www.packaginghero.com/36-x-18-x-74-4-shelf-wire-shelving-ph-715149', 'https://www.packaginghero.com/orange-sharpie-fine-point-markers-ph-734125', 'https://www.packaginghero.com/6-shelf-wire-shelving-with-blue-bins-ph-715135', 'https://www.packaginghero.com/second-chance-trash-bag-black-56-gal-ph-755131', 'https://www.packaginghero.com/36-x-58-clear-can-liners-ph-751133', 'https://www.packaginghero.com/8-1-2-x-11-solid-back-job-ticket-holder-ph-731137', 'https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-blue-stack-hang-bin-ph-711101', 'https://www.packaginghero.com/infectious-waste-trash-liner-30-gallon-ph-758101', 'https://www.packaginghero.com/17-7-8-x-6-5-8-x-4-green-shelf-bins-ph-711357', 'https://www.packaginghero.com/second-chance-trash-bag-clear-60-gal-ph-755165', 'https://www.packaginghero.com/scott-2-ply-coreless-bathroom-tissue-ph-821019', 'https://www.packaginghero.com/brute-trash-can-10-gallon-white-ph-743141', 'https://www.packaginghero.com/11-x-8-1-2-job-ticket-holders-ph-731133', 'https://www.packaginghero.com/5-x-36-2-mil-flat-poly-bag-ph-311428', 'https://www.packaginghero.com/6-x-6-green-waterhog-mat-ph-737265', 'https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-clear-stack-hang-bin-ph-711229', 'https://www.packaginghero.com/24-x-23-clear-can-liners-ph-751103', 'https://www.packaginghero.com/4-x-6-charcoal-deluxe-vinyl-carpet-mat-ph-737474', 'https://www.packaginghero.com/9-x-12-neon-pink-job-ticket-holders-ph-731127', 'https://www.packaginghero.com/second-chance-trash-bag-black-55-60-gal-ph-755127', 'https://www.packaginghero.com/1-x-60-yds-3m-401+-233+-masking-tape-ph-681543', 'https://www.packaginghero.com/18-x-30-4-mil-reclosable-poly-bag-ph-315618', 'https://www.packaginghero.com/brute-trash-can-20-gallon-blue-ph-743161', 'https://www.packaginghero.com/17-7-8-x-8-3-8-x-4-yellow-shelf-bins-ph-711371', 'https://www.packaginghero.com/best-nighthawk-nitrile-gloves-medium-ph-891043', 'https://www.packaginghero.com/18-x-22-3-mil-flat-poly-bag-ph-311959', 'https://www.packaginghero.com/36-x-12-x-86-wire-shelving-add-on-unit-ph-715129', 'https://www.packaginghero.com/4-x-6-burgundy-deluxe-entry-mat-ph-737456', 'https://www.packaginghero.com/4-x-10-green-waterhog-mat-ph-737247', 'https://www.packaginghero.com/brute-flat-trash-can-lid-55-gal-green-ph-743279', 'https://www.packaginghero.com/3-x-60-black-yellow-anti-fatigue-mat-ph-737375', 'https://www.packaginghero.com/contractors-bag-black-40-45-gal-3-mil-ph-756107', 'https://www.packaginghero.com/2-x-60-yds-3m-401+-233+-masking-tape-ph-681751', 'https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-yellow-stack-hang-bin-ph-711113', 'https://www.packaginghero.com/pvc-black-dot-knit-gloves-medium-ph-891405', 'https://www.packaginghero.com/23-x-33-black-can-liners-ph-751143', 'https://www.packaginghero.com/sps-92-duratip-safety-utility-blades-ph-732177', 'https://www.packaginghero.com/gojo-multi-green-hand-cleaner-refill-ph-822029', 'https://www.packaginghero.com/pvc-black-dot-knit-gloves-small-ph-891403', 'https://www.packaginghero.com/11-5-8-x-6-5-8-x-4-red-shelf-bins-ph-711321', 'https://www.packaginghero.com/36-x-58-clear-can-liners-ph-751129', 'https://www.packaginghero.com/door-sign-conference-ph-781173', 'https://www.packaginghero.com/18-x-11-x-10-clear-stack-hang-bins-ph-711271', 'https://www.packaginghero.com/1-2-x-120-yds-3m-860-poly-strapping-tape-ph-643005', 'https://www.packaginghero.com/6-x-20-red-black-waterhog-runner-ph-737304', 'https://www.packaginghero.com/kimtech-12-x-168-prep-dispenser-box-wipers-ph-844031', 'https://www.packaginghero.com/slim-jim-swing-top-lid-23-gallon-gray-ph-742179', 'https://www.packaginghero.com/3.15-x-984-black-zebra-thermal-transfer-ribbons-wax-ph-415133', 'https://www.packaginghero.com/3-x-10-black-marble-anti-fatigue-mat-ph-737138', 'https://www.packaginghero.com/brute-flat-trash-can-lid-55-gal-black-ph-743275', 'https://www.packaginghero.com/9-x-12-neon-green-job-ticket-holders-ph-731123', 'https://www.packaginghero.com/brute-trash-can-55-gallon-yellow-ph-743269', 'https://www.packaginghero.com/sn-395-quick-change-knife-ph-732137', 'https://www.packaginghero.com/latex-glove-powder-free-w-extended-cuff-m-ph-891167', 'https://www.packaginghero.com/6-x-16-navy-waterhog-mat-ph-737291', 'https://www.packaginghero.com/60-x-36-x-86-wire-shelving-add-on-unit-ph-715275', 'https://www.packaginghero.com/square-recycling-container-50-gal-blue-ph-742147', 'https://www.packaginghero.com/sn-195-standard-utility-knife-ph-732117', 'https://www.packaginghero.com/72-x-24-x-63-wire-shelving-add-on-unit-ph-715299', 'https://www.packaginghero.com/48-x-12-x-63-4-shelf-wire-shelving-ph-715185', 'https://www.packaginghero.com/26-x-19-x-15-5-8-gray-round-trip-tote-ph-717107', 'https://www.packaginghero.com/paper-plates-9-ph-882100', 'https://www.packaginghero.com/nitrile-gloves-6-mil-large-ph-891193', 'https://www.packaginghero.com/3-x-6-charcoal-waterhog-mat-ph-737192', 'https://www.packaginghero.com/48-x-12-wire-shelves-ph-715339', 'https://www.packaginghero.com/ukh-326-leather-holster-ph-732149', 'https://www.packaginghero.com/second-chance-trash-bag-black-6-bushel-ph-755137', 'https://www.packaginghero.com/4-x-16-brown-waterhog-mat-ph-737257', 'https://www.packaginghero.com/pigskin-leather-drivers-gloves-large-ph-891285', 'https://www.packaginghero.com/second-chance-trash-bag-black-15-gal-ph-755103', 'https://www.packaginghero.com/3-x-10-brown-waterhog-elite-mat-ph-737399', 'https://www.packaginghero.com/spd-017-safety-point-blade-dispenser-ph-732201', 'https://www.packaginghero.com/vinyl-glove-3-mil-powdered-m-ph-891349', 'https://www.packaginghero.com/brute-roll-out-container-50-gallon-gray-ph-747101', 'https://www.packaginghero.com/3-x-20-medium-gray-waterhog-runner-ph-737308', 'https://www.packaginghero.com/40-x-46-black-can-liners-ph-751175', 'https://www.packaginghero.com/12-x-8-x-20-3-mil-gusseted-poly-bag-ph-318411', 'https://www.packaginghero.com/60-x-24-x-86-wire-shelving-add-on-unit-ph-715259', 'https://www.packaginghero.com/hd-trash-bag-natural-7-10-gallon-23-mil-ph-754101', 'https://www.packaginghero.com/fire-extinguisher-9-x-6-facility-sign-ph-781151', 'https://www.packaginghero.com/4-x-6-black-economy-anti-fatigue-mat-ph-737380', 'https://www.packaginghero.com/contractors-bag-black-33-gallon-30-mil-ph-756103', 'https://www.packaginghero.com/wypall-x80-125-x-168-heavy-duty-wipers-ph-843055', 'https://www.packaginghero.com/3.00-x-1181-black-datamax-thermal-transfer-ribbons-ph-415125', 'https://www.packaginghero.com/leather-palm-w-safety-cuff-gloves-m-ph-891309', 'https://www.packaginghero.com/9-x-12-neon-blue-job-ticket-holders-ph-731121', 'https://www.packaginghero.com/shop-towels-14-x-14-red-5-lb-box-ph-827035', 'https://www.packaginghero.com/deerskin-leather-drivers-gloves-xlarge-ph-891299', 'https://www.packaginghero.com/square-recycling-container-23-gal-blue-ph-742139', 'https://www.packaginghero.com/8-shelf-wire-shelving-with-blue-bins-ph-715103', 'https://www.packaginghero.com/72-x-24-x-63-4-shelf-wire-shelving-ph-715297', 'https://www.packaginghero.com/3m-8210-dust-respirator-ph-723115', 'https://www.packaginghero.com/black-marsh-88-valve-markers-ph-734103', 'https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-black-stack-hang-bin-ph-711205', 'https://www.packaginghero.com/square-recycling-slotted-lid-23-gal-blue-ph-742141', 'https://www.packaginghero.com/17-7-8-x-6-5-8-x-4-blue-shelf-bins-ph-711353', 'https://www.packaginghero.com/33-x-40-Clear-Can-Liners-PH-751119', 'https://www.packaginghero.com/1-x-60-yds-13m-201+-masking-tape-ph-681475', 'https://www.packaginghero.com/12-x-20-6-mil-reclosable-poly-bag-ph-315498', 'https://www.packaginghero.com/33-x-39-clear-can-liners-ph-751115', 'https://www.packaginghero.com/kimwipes-1-ply-44-x-84-low-lint-wipers-ph-844013', 'https://www.packaginghero.com/hd-trash-bag-black-56-gallon-86-mil-ph-754155', 'https://www.packaginghero.com/72-x-36-x-86-wire-shelving-add-on-unit-ph-715323', 'https://www.packaginghero.com/74-chrome-poles-2-pack-ph-715381', 'https://www.packaginghero.com/36-x-18-x-63-4-shelf-wire-shelving-ph-715141', 'https://www.packaginghero.com/3-x-10-green-waterhog-mat-ph-737205', 'https://www.packaginghero.com/door-sign-stairs-ph-781199', 'https://www.packaginghero.com/nitrile-gloves-with-extended-cuffs-m-ph-891215', 'https://www.packaginghero.com/24-x-31-clear-can-liners-ph-751107', 'https://www.packaginghero.com/latex-industrial-gloves-small-ph-891147', 'https://www.packaginghero.com/6-x-20-charcoal-waterhog-runner-ph-737300', 'https://www.packaginghero.com/brute-flat-trash-can-lid-20-gal-yellow-ph-743185', 'https://www.packaginghero.com/bc-347-safety-bag-cutter-ph-732199', 'https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-red-stack-hang-bins-ph-711123', 'https://www.packaginghero.com/11-5-8-x-11-1-8-x-4-red-shelf-bins-ph-711339', 'https://www.packaginghero.com/36-x-18-x-63-wire-shelving-add-on-unit-ph-715145', 'https://www.packaginghero.com/40-x-46-black-can-liners-ph-751171', 'https://www.packaginghero.com/brute-trash-can-20-gallon-green-ph-743163', 'https://www.packaginghero.com/continuous-air-freshener-refill-blue-splash-ph-827011', 'https://www.packaginghero.com/e-a-rsoft-yellow-neons-earplugs-ph-725105', 'https://www.packaginghero.com/5-1-4-x-2-1-4-x-15-1-1-2-mil-gusseted-poly-bag-ph-318141', 'https://www.packaginghero.com/4-x-12-brown-waterhog-mat-ph-737251', 'https://www.packaginghero.com/brute-recycling-container-32-gal-green-ph-742125', 'https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-green-stack-hang-bin-ph-711105', 'https://www.packaginghero.com/6-x-12-green-waterhog-mat-ph-737283', 'https://www.packaginghero.com/48-x-12-x-74-wire-shelving-add-on-unit-ph-715191', 'https://www.packaginghero.com/3-x-8-black-economy-anti-fatigue-mat-ph-737359', 'https://www.packaginghero.com/brute-square-dolly-ph-743121', 'https://www.packaginghero.com/23-5-8-x-8-3-8-x-4-blue-shelf-bins-ph-711401', 'https://www.packaginghero.com/hd-trash-bag-natural-40-45-gal-55-mil-ph-754119', 'https://www.packaginghero.com/17-x-8-1-4-stack-hang-bin-dividers-ph-712115', 'https://www.packaginghero.com/3-x-4-premium-anti-fatigue-mat-ph-737421', 'https://www.packaginghero.com/blue-recycling-trash-bag-55-60-gal-ph-757117', 'https://www.packaginghero.com/twin-bathroom-tissue-dispenser-black-ph-821027', 'https://www.packaginghero.com/17-x-10-1-4-stack-hang-bin-dividers-ph-712123', 'https://www.packaginghero.com/40-x-46-black-can-liners-ph-751173', 'https://www.packaginghero.com/sharpie-metallic-marker-silver-ph-734157', 'https://www.packaginghero.com/22-1-2-x-24-1-2-black-can-liners-ph-751137', 'https://www.packaginghero.com/60-x-24-x-54-4-shelf-wire-shelving-ph-715245', 'https://www.packaginghero.com/no-admittance-6-x-9-facility-sign-ph-781137', 'https://www.packaginghero.com/23-x-33-black-can-liners-ph-751147', 'https://www.packaginghero.com/6-x-8-brown-waterhog-mat-ph-737269', 'https://www.packaginghero.com/60-x-18-x-86-wire-shelving-add-on-unit-ph-715243', 'https://www.packaginghero.com/door-sign-women-ph-781193', 'https://www.packaginghero.com/17-7-8-x-6-5-8-x-4-yellow-shelf-bins-ph-711361', 'https://www.packaginghero.com/black-sharpie-chisel-tip-markers-ph-734153', 'https://www.packaginghero.com/48-x-12-x-86-wire-shelving-add-on-unit-ph-715195', 'https://www.packaginghero.com/box-of-huck-towels-blue-25-lb-box-ph-827047', 'https://www.packaginghero.com/11-5-8-x-8-3-8-x-4-yellow-shelf-bins-ph-711333', 'https://www.packaginghero.com/72-x-18-wire-shelves-2-pack-ph-715363', 'https://www.packaginghero.com/16-x-11-x-8-ivory-stack-hang-bins-ph-711251', 'https://www.packaginghero.com/72-x-36-x-54-4-shelf-wire-shelving-ph-715309', 'https://www.packaginghero.com/kimtech-1-ply-147-x-166-precision-low-lint-wipers-ph-844027', 'https://www.packaginghero.com/cotton-inspection-gloves-25-oz-small-ph-891227', 'https://www.packaginghero.com/quickblade-retractable-utility-knife-ph-732101', 'https://www.packaginghero.com/terry-cloth-towels-white-25-lb-box-ph-827039', 'https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-yellow-stack-hang-bin-ph-711183', 'https://www.packaginghero.com/toilet-seat-cover-dispenser-chrome-ph-824009', 'https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-ivory-stack-hang-bin-ph-711167', 'https://www.packaginghero.com/hd-trash-bag-black-60-gallon-55-mil-ph-754159', 'https://www.packaginghero.com/9-1-4-x-6-x-5-yellow-stack-hang-bins-ph-711141', 'https://www.packaginghero.com/gojo-wall-mount-dispenser-white-ph-822041', 'https://www.packaginghero.com/scott-rags-in-a-box-ph-845001', 'https://www.packaginghero.com/6-shelf-wire-shelving-with-blue-bins-ph-715119', 'https://www.packaginghero.com/18-x-13-x-12-white-space-age-totes-ph-716107', 'https://www.packaginghero.com/twin-toliet-tissue-dispenser-steel-ph-821037', 'https://www.packaginghero.com/glad-forceflex-trash-bag-30-gal-black-ph-753107', 'https://www.packaginghero.com/door-sign-no-smoking-ph-781181', 'https://www.packaginghero.com/scott-rags-in-a-box-(2-pack)-ph-845003', 'https://www.packaginghero.com/brute-square-can-flat-lid-28-gal-white-ph-743111', 'https://www.packaginghero.com/1-x-60-yds-3m-401+-233+-masking-tape-ph-681607', 'https://www.packaginghero.com/18-x-8-1-4-x-9-clear-stack-hang-bins-ph-711257', 'https://www.packaginghero.com/18-x-14-x-12-20-pack-corrugated-box-ph-103703', 'https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-green-stack-hang-bin-ph-711161', 'https://www.packaginghero.com/ms-410-scraper-knife-ph-732147', 'https://www.packaginghero.com/18-x-16-1-2-x-11-ivory-stack-hang-bin-ph-711293', 'https://www.packaginghero.com/48-x-18-x-63-wire-shelving-add-on-unit-ph-715203', 'https://www.packaginghero.com/door-sign-no-admittance-ph-781189', 'https://www.packaginghero.com/16-x-11-x-8-green-stack-hang-bins-ph-711245', 'https://www.packaginghero.com/e-a-r-classic-earplugs-in-pillow-pak-ph-725109', 'https://www.packaginghero.com/rubbermaid-brute-tandem-dolly-ph-743129', 'https://www.packaginghero.com/scott-coreless-toliet-tissue-dispenser-ph-821039', 'https://www.packaginghero.com/86-chrome-poles-ph-715387', 'https://www.packaginghero.com/60-x-24-wire-shelf-ph-715353', 'https://www.packaginghero.com/urinal-flat-screen-ph-826005', 'https://www.packaginghero.com/36-x-58-black-can-liners-ph-751183', 'https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-black-conductive-bins-ph-711419', 'https://www.packaginghero.com/ukh-325-2-pocket-nylon-holster-ph-732145', 'https://www.packaginghero.com/36-x-18-x-54-4-shelf-wire-shelving-ph-715133', 'https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-ivory-stack-hang-bin-ph-711153', 'https://www.packaginghero.com/10-7-8-x-11-x-5-ivory-stack-hang-bins-ph-711195', 'https://www.packaginghero.com/deerskin-leather-drivers-gloves-large-ph-891297', 'https://www.packaginghero.com/rsg-194-safety-grip-utility-knife-yellow-ph-732109', 'https://www.packaginghero.com/2-x-3-6-mil-anti-static-flat-poly-bag-ph-331293', 'https://www.packaginghero.com/9-x-12-neon-yellow-job-ticket-holders-ph-731131', 'https://www.packaginghero.com/36-x-24-x-86-4-shelf-wire-shelving-ph-715177', 'https://www.packaginghero.com/hands-free-trash-can-lid-23-gallon-beige-ph-746115', 'https://www.packaginghero.com/11-5-8-x-4-1-8-x-4-clear-shelf-bins-ph-711313', 'https://www.packaginghero.com/hd-trash-bag-black-60-gallon-87-mil-ph-754163', 'https://www.packaginghero.com/wooden-wet-floor-sign-2-sided-ph-836007', 'https://www.packaginghero.com/brute-recycling-single-stream-lid-green-ph-742121', 'https://www.packaginghero.com/72-x-18-x-54-4-shelf-wire-shelving-ph-715277', 'https://www.packaginghero.com/4-x-4-red-black-waterhog-mat-ph-737226', 'https://www.packaginghero.com/brute-flat-trash-can-lid-20-gal-black-ph-743173', 'https://www.packaginghero.com/wet-floor-safety-pop-up-cone-3-sided-ph-836003', 'https://www.packaginghero.com/ansell-touch-n-tuff-nitrile-gloves-m-ph-891019', 'https://www.packaginghero.com/60-x-24-x-86-4-shelf-wire-shelving-ph-715257', 'https://www.packaginghero.com/qba-375-quickblade-auto-load-knife-ph-732163', 'https://www.packaginghero.com/box-of-rags-colored-t-shirt-50-lb-box-ph-827045', 'https://www.packaginghero.com/3-x-20-charcoal-waterhog-runner-ph-737306', 'https://www.packaginghero.com/employees-must-wash-hands-6-x-9-facility-sign-ph-781143', 'https://www.packaginghero.com/1-x-60-yds-3m-101+-masking-tape-ph-681557', 'https://www.packaginghero.com/72-x-24-x-54-4-shelf-wire-shelving-ph-715293', 'https://www.packaginghero.com/cowhide-leather-drivers-gloves-lined-l-ph-891267', 'https://www.packaginghero.com/36-x-24-x-74-wire-shelving-add-on-unit-ph-715175', 'https://www.packaginghero.com/1-x-60-yds-3m-301+-masking-tape-ph-681605', 'https://www.packaginghero.com/brute-recycling-container-32-gal-blue-ph-742123', 'https://www.packaginghero.com/2-x-60-black-economy-anti-fatigue-mat-ph-737347', 'https://www.packaginghero.com/pro-fingerless-glove-w-wrist-strap-m-ph-891119', 'https://www.packaginghero.com/36-x-12-x-86-4-shelf-wire-shelving-ph-715125', 'https://www.packaginghero.com/3-x-6-premium-anti-fatigue-mat-ph-737425', 'https://www.packaginghero.com/12-x-13-4-mil-reclosable-poly-bag-ph-315494', 'https://www.packaginghero.com/rubber-coated-palm-gloves-extra-large-ph-891433', 'https://www.packaginghero.com/4-x-6-gray-marble-anti-fatigue-mat-ph-737147', 'https://www.packaginghero.com/3-x-5-brown-deluxe-entry-mat-ph-737451', 'https://www.packaginghero.com/48-x-12-x-74-4-shelf-wire-shelving-ph-715189', 'https://www.packaginghero.com/kimwipes-3-ply-118-x-118-low-lint-wipers-ph-844019', 'https://www.packaginghero.com/18-x-8-1-4-x-9-blue-stack-hang-bins-ph-711255', 'https://www.packaginghero.com/brute-steel-dome-lid-55-gallon-green-ph-743291', 'https://www.packaginghero.com/37-x-1000-scott-surpass-toliet-tissue-ph-821015', 'https://www.packaginghero.com/3-x-60-charcoal-vinyl-carpet-mat-ph-737545', 'https://www.packaginghero.com/second-chance-trash-bag-black-33-gal-ph-755111', 'https://www.packaginghero.com/23-5-8-x-6-5-8-x-4-green-shelf-bins-ph-711395', 'https://www.packaginghero.com/2-x-3-green-superior-vinyl-carpet-mat-ph-737480', 'https://www.packaginghero.com/2-x-3-walnut-marble-anti-fatigue-mat-ph-737108', 'https://www.packaginghero.com/8-1-2-x-12-kraft-2-padded-mailers-ph-251125', 'https://www.packaginghero.com/2-x-60-yds-blue-secure-tape-ph-616003', 'https://www.packaginghero.com/brute-trash-can-32-gallon-white-ph-743197', 'https://www.packaginghero.com/cowhide-leather-drivers-gloves-large-ph-891261', 'https://www.packaginghero.com/box-of-rags-colored-t-shirt-25-lb-box-ph-827043', 'https://www.packaginghero.com/hd-trash-bag-black-40-45-gallon-86-mil-ph-754149', 'https://www.packaginghero.com/60-x-36-x-63-wire-shelving-add-on-unit-ph-715267', 'https://www.packaginghero.com/second-chance-trash-bag-black-6-bushel-ph-755135', 'https://www.packaginghero.com/1-1-2-x-60-yds-3m-501+-masking-tape-ph-681665', 'https://www.packaginghero.com/3-x-6-black-yellow-anti-fatigue-mat-ph-737357', 'https://www.packaginghero.com/72-x-24-x-54-wire-shelving-add-on-unit-ph-715295', 'https://www.packaginghero.com/ez2-concealed-blade-safety-cutter-ph-732171', 'https://www.packaginghero.com/pro-fingerless-glove-l-ph-891113', 'https://www.packaginghero.com/23-5-8-x-4-1-8-x-4-clear-shelf-bins-ph-711383', 'https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-black-stack-hang-bin-ph-711121', 'https://www.packaginghero.com/brute-flat-trash-can-lid-44-gal-black-ph-743243', 'https://www.packaginghero.com/86-chrome-poles-ph-715385', 'https://www.packaginghero.com/17-7-8-x-8-3-8-x-4-green-shelf-bins-ph-711367', 'https://www.packaginghero.com/63-chrome-poles-2-pack-ph-715377', 'https://www.packaginghero.com/8-x-4-x-15-2-mil-gusseted-reclosable-poly-bag-ph-318325', 'https://www.packaginghero.com/knifehandler-gloves-large-ph-891065', 'https://www.packaginghero.com/60-x-18-x-86-4-shelf-wire-shelving-ph-715241', 'https://www.packaginghero.com/3-in-1-safety-cutter-left-handed-ph-732155', 'https://www.packaginghero.com/5-shelf-wire-shelving-with-yellow-bins-ph-715163', 'https://www.packaginghero.com/second-chance-trash-bag-clear-40-45-gal-ph-755155', 'https://www.packaginghero.com/72-x-18-x-74-wire-shelving-add-on-unit-ph-715287', 'https://www.packaginghero.com/gojo-wall-mount-dispenser-gray-ph-822045', 'https://www.packaginghero.com/second-chance-trash-bag-black-56-gal-ph-755129', 'https://www.packaginghero.com/wypall-l30-economy-10-x-98-wipers-dispenser-ph-843011', 'https://www.packaginghero.com/28-x-18-x-11-white-brute-totes-w-lid-ph-717165', 'https://www.packaginghero.com/rsc-432-disposable-safety-cutter-ph-732129', 'https://www.packaginghero.com/blue-sharpie-magnum-markers-ph-734143', 'https://www.packaginghero.com/12-x-10-3-mil-flat-poly-bag-ph-311965', 'https://www.packaginghero.com/brute-trash-can-55-gallon-green-ph-743261', 'https://www.packaginghero.com/leather-palm-w-safety-cuff-gloves-l-ph-891311', 'https://www.packaginghero.com/wheelchair-accessible-ada-compliant-plastic-sign-ph-781101', 'https://www.packaginghero.com/slim-jim-bottle-and-can-recycling-lid-green-ph-742103', 'https://www.packaginghero.com/ansell-touch-n-tuff-nitrile-glove-xl-ph-891023', 'https://www.packaginghero.com/4-x-6-brown-superior-vinyl-carpet-mat-ph-737496', 'https://www.packaginghero.com/cotton-inspection-gloves-35-oz-large-ph-891235', 'https://www.packaginghero.com/3-x-12-navy-waterhog-mat-ph-737213', 'https://www.packaginghero.com/13-15-16-x-4-3-4-stack-hang-dividers-ph-712113', 'https://www.packaginghero.com/8-3-8-x-4-1-2-stack-hang-bin-dividers-ph-712103', 'https://www.packaginghero.com/brute-trash-can-44-gallon-gray-ph-743229', 'https://www.packaginghero.com/28-x-18-x-15-gray-brute-totes-with-lid-ph-717167', 'https://www.packaginghero.com/please-clean-microwave-6-x-9-facility-sign-ph-781129', 'https://www.packaginghero.com/banding-and-strapping-safety-cutter-ph-732197', 'https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-red-stack-hang-bin-ph-711151', 'https://www.packaginghero.com/18-x-11-x-10-black-stack-hang-bins-ph-711275', 'https://www.packaginghero.com/ansell-tnt-nitrile-gloves-xlarge-ph-891015', 'https://www.packaginghero.com/e-a-rsoft-yellow-neons-corded-earplugs-ph-725107', 'https://www.packaginghero.com/sweeping-compound-300-lb-drum-ph-842011', 'https://www.packaginghero.com/3-x-8-charcoal-economy-vinyl-carpet-mat-ph-737525', 'https://www.packaginghero.com/3m-8515-welding-respirator-with-valve-ph-723123', 'https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-blue-stack-hang-bin-ph-711171', 'https://www.packaginghero.com/4-x-10-brown-waterhog-mat-ph-737245', 'https://www.packaginghero.com/10-1-8-x-4-3-4-stack-hang-dividers-ph-712109', 'https://www.packaginghero.com/wet-floor-sign-2-sided-english-stand-ph-836001', 'https://www.packaginghero.com/9-x-12-magnetic-job-ticket-holders-ph-731153', 'https://www.packaginghero.com/magic-soft-facial-tissue-ph-881001', 'https://www.packaginghero.com/17-7-8-x-8-3-8-x-4-blue-shelf-bins-ph-711363', 'https://www.packaginghero.com/2-x-4-warning-hazardous-voltage-durable-safety-label-ph-414049', 'https://www.packaginghero.com/dfc-364-disposable-film-cutter-ph-732141', 'https://www.packaginghero.com/2-x-60-yds-3m-101+-masking-tape-ph-681705', 'https://www.packaginghero.com/vinyl-gloves-5-mil-powdered-l-ph-891367', 'https://www.packaginghero.com/40-x-46-clear-can-liners-ph-751125', 'https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-black-conductive-bin-ph-711423', 'https://www.packaginghero.com/5-x-7-2-milhangholereclosable-poly-bag-ph-315054', 'https://www.packaginghero.com/72-x-18-x-63-wire-shelving-add-on-unit-ph-715283', 'https://www.packaginghero.com/18-x-36-1-1-2-mil-flat-poly-bag-ph-311945', 'https://www.packaginghero.com/gojo-natural-orange-smooth-hand-cleaner-refill-ph-822023', 'https://www.packaginghero.com/17-x-14-1-2-x-9-7-8-red-stack-nest-bin-ph-717117', 'https://www.packaginghero.com/gojo-wall-mount-dispenser-gray-ph-822043', 'https://www.packaginghero.com/contractors-bag-black-40-55-gal-3-mil-ph-756105', 'https://www.packaginghero.com/box-of-rags-standard-50-lb-box-ph-827023', 'https://www.packaginghero.com/1-x-60-yds-13m-501+-masking-tape-ph-681545', 'https://www.packaginghero.com/4-x-12-green-waterhog-mat-ph-737253', 'https://www.packaginghero.com/clear-poly-gloves-1-mil-ph-891125', 'https://www.packaginghero.com/36-x-12-x-74-wire-shelving-add-on-unit-ph-715121', 'https://www.packaginghero.com/4-x-60-black-yellow-anti-fatigue-mat-ph-737393', 'https://www.packaginghero.com/white-mean-streak-paint-in-a-tube-ph-734161', 'https://www.packaginghero.com/4-x-6-black-yellow-anti-fatigue-mat-ph-737381', 'https://www.packaginghero.com/rb-009-single-edge-blades-ph-732193', 'https://www.packaginghero.com/purple-sharpie-fine-point-markers-ph-734127', 'https://www.packaginghero.com/safety-cutter-utility-knife-right-handed-ph-732121', 'https://www.packaginghero.com/kimtech-98-x-134-prep-jumbo-roll-wipers-ph-844033', 'https://www.packaginghero.com/40-x-46-clear-can-liners-ph-751127', 'https://www.packaginghero.com/18-x-8-1-4-x-9-ivory-stack-hang-bins-ph-711265', 'https://www.packaginghero.com/6-x-16-red-black-waterhog-mat-ph-737292', 'https://www.packaginghero.com/54-chrome-poles-2-pack-ph-715373', 'https://www.packaginghero.com/second-chance-trash-bag-clear-15-gal-ph-755147', 'https://www.packaginghero.com/white-spring-back-pocket-safety-cutter-ph-732187', 'https://www.packaginghero.com/ansell-conform-xt-latex-exam-glove-l-ph-891005', 'https://www.packaginghero.com/4-x-20-green-waterhog-runner-ph-737295', 'https://www.packaginghero.com/brute-trash-can-10-gallon-yellow-ph-743143', 'https://www.packaginghero.com/ez3-spring-back-safety-utility-knife-ph-732133', 'https://www.packaginghero.com/3-x-6-8-mil-reclosable-poly-bag-ph-315192', 'https://www.packaginghero.com/scott-blue-shop-towels-on-a-roll-ph-845009', 'https://www.packaginghero.com/7-x-3-plastic-shelf-bin-dividers-ph-712129', 'https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-red-stack-hang-bin-ph-711235', 'https://www.packaginghero.com/48-x-12-wire-shelf-ph-715337', 'https://www.packaginghero.com/1-2-x-60-yds-3m-860-poly-strapping-tape-ph-643013', 'https://www.packaginghero.com/toilet-seat-covers-ph-824003', 'https://www.packaginghero.com/scrubs-in-a-bucket-hand-cleaner-towels-ph-841101', 'https://www.packaginghero.com/36-x-18-x-54-wire-shelving-add-on-unit-ph-715137', 'https://www.packaginghero.com/slim-jim-trash-can-23-gallon-yellow-ph-742171', 'https://www.packaginghero.com/225-triangle-entanglement-hazard-durable-safety-label-ph-414109', 'https://www.packaginghero.com/black-sharpie-magnum-markers-ph-734145', 'https://www.packaginghero.com/white-marsh-88fx-metal-paint-markers-ph-734115', 'https://www.packaginghero.com/5-x-11-2-mil-flat-poly-bag-ph-311427', 'https://www.packaginghero.com/vinyl-gloves-5-mil-powdered-xl-ph-891369', 'https://www.packaginghero.com/6-x-12-red-black-waterhog-mat-ph-737286', 'https://www.packaginghero.com/3-1-4-x-1-3-4-x-3-yellow-shelf-bin-cups-ph-713103', 'https://www.packaginghero.com/36-x-58-black-can-liners-ph-751185', 'https://www.packaginghero.com/60-x-18-x-63-wire-shelving-add-on-unit-ph-715235', 'https://www.packaginghero.com/72-x-36-x-63-wire-shelving-add-on-unit-ph-715315', 'https://www.packaginghero.com/pvc-blue-dot-knit-gloves-small-ph-891411', 'https://www.packaginghero.com/39-x-46-sure-sak-can-liners-ph-752105', 'https://www.packaginghero.com/10-7-8-x-11-x-5-blue-stack-hang-bins-ph-711185', 'https://www.packaginghero.com/48-x-24-x-86-4-shelf-wire-shelving-ph-715225', 'https://www.packaginghero.com/11-5-8-x-8-3-8-x-4-green-shelf-bins-ph-711329', 'https://www.packaginghero.com/9-x-12-neon-job-ticket-holders-pack-ph-731143', 'https://www.packaginghero.com/kimtech-wipers-pop-up-box-ph-844041', 'https://www.packaginghero.com/36-x-24-x-63-4-shelf-wire-shelving-ph-715169', 'https://www.packaginghero.com/safety-cutter-utility-knife-left-handed-ph-732125', 'https://www.packaginghero.com/48-x-24-x-86-wire-shelving-add-on-unit-ph-715227', 'https://www.packaginghero.com/6-x-8-green-waterhog-mat-ph-737271', 'https://www.packaginghero.com/nitrile-glove-accelerator-free-xl-ph-891039', 'https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-black-stack-hang-bin-ph-711149', 'https://www.packaginghero.com/26-5-8-x-18-1-4-x-14-7-8-gray-stack-nest-bin-ph-717137', 'https://www.packaginghero.com/office-recycling-container-10-gal-blue-ph-742135', 'https://www.packaginghero.com/3-x-4-medium-gray-waterhog-mat-ph-737182', 'https://www.packaginghero.com/5-x-1-1-4-polyurethane-swivel-casters-ph-715389', 'https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-yellow-stack-hang-bin-ph-711225', 'https://www.packaginghero.com/3-1-4-x-1-3-4-x-3-blue-shelf-bin-cups-ph-713101', 'https://www.packaginghero.com/23-5-8-x-6-5-8-x-4-clear-shelf-bins-ph-711393', 'https://www.packaginghero.com/stainless-steel-wall-mount-sanitary-receptacle-ph-825003', 'https://www.packaginghero.com/6-x-6-brown-waterhog-mat-ph-737263', 'https://www.packaginghero.com/36-x-24-wire-shelf-ph-715333', 'https://www.packaginghero.com/3-x-5-brown-waterhog-mat-ph-737185', 'https://www.packaginghero.com/9-7-8-x-6-3-4-stack-hang-bin-dividers-ph-712107', 'https://www.packaginghero.com/swing-top-sanitary-napkin-receptacle-ph-825007', 'https://www.packaginghero.com/brute-flat-trash-can-lid-10-gallon-gray-ph-743151', 'https://www.packaginghero.com/shop-towels-natural-25-lb-box-ph-827033', 'https://www.packaginghero.com/6-x-20-brown-waterhog-runner-ph-737299', 'https://www.packaginghero.com/latex-industrial-gloves-powder-free-xl-ph-891163', 'https://www.packaginghero.com/6-x-12-brown-waterhog-mat-ph-737281', 'https://www.packaginghero.com/door-sign-office-ph-781171', 'https://www.packaginghero.com/nitrile-glove-extended-cuff-xl-ph-891055', 'https://www.packaginghero.com/esd-uncoated-nylon-gloves-extra-large-ph-891075', 'https://www.packaginghero.com/string-knit-cotton-gloves-small-ph-891419', 'https://www.packaginghero.com/10-7-8-x-11-x-5-black-stack-hang-bins-ph-711191', 'https://www.packaginghero.com/24-x-24-4-mil-anti-static-poly-bag-ph-331277', 'https://www.packaginghero.com/toilet-seat-cover-dispenser-smoke-ph-824005', 'https://www.packaginghero.com/yellow-marsh-88fx-metal-paint-markers-ph-734117', 'https://www.packaginghero.com/door-sign-elevator-ph-781197', 'https://www.packaginghero.com/60-x-36-x-54-wire-shelving-add-on-unit-ph-715263', 'https://www.packaginghero.com/qbd-379-quickblade-blade-dispenser-ph-732203', 'https://www.packaginghero.com/avoid-a-fall-9-x-6-facility-sign-ph-781157', 'https://www.packaginghero.com/fluorescent-orange-sharpie-highlighters-ph-734167', 'https://www.packaginghero.com/single-toliet-tissue-dispenser-black-ph-821031', 'https://www.packaginghero.com/fingerless-pvc-dot-knit-gloves-large-ph-891417', 'https://www.packaginghero.com/nitrile-gloves-exam-grade-xlarge-ph-891179', 'https://www.packaginghero.com/4-x-12-black-economy-anti-fatigue-mat-ph-737386', 'https://www.packaginghero.com/ansell-touch-n-tuff-nitrile-gloves-l-ph-891021', 'https://www.packaginghero.com/brute-flat-trash-can-lid-20-gallon-blue-ph-743175', 'https://www.packaginghero.com/3-x-60-yds-3m-301+-masking-tape-ph-681789', 'https://www.packaginghero.com/t1-tape-splitter-ph-732191', 'https://www.packaginghero.com/7-3-8-x-4-1-8-x-3-ivory-stack-hang-bin-ph-711125', 'https://www.packaginghero.com/hd-trash-bag-natural-60-gallon-67-mil-ph-754131', 'https://www.packaginghero.com/30-x-60-3-mil-flat-poly-bag-ph-312392', 'https://www.packaginghero.com/liners-for-swing-top-sanitary-receptacle-ph-825009', 'https://www.packaginghero.com/24-x-23-clear-can-liners-ph-751101', 'https://www.packaginghero.com/4-x-60-red-economy-vinyl-carpet-mat-ph-737567', 'https://www.packaginghero.com/40-x-46-clear-can-liners-ph-751123', 'https://www.packaginghero.com/3-x-6-gray-economy-anti-fatigue-mat-ph-737358', 'https://www.packaginghero.com/door-sign-restrooms-ph-781191', 'https://www.packaginghero.com/nitrile-gloves-with-beaded-cuff-large-ph-891223', 'https://www.packaginghero.com/20-1-4-x-14-1-4-x-9-5-8-round-trip-tote-ph-717101', 'https://www.packaginghero.com/hd-trash-bag-natural-60-gallon-55-mil-ph-754129', 'https://www.packaginghero.com/brute-flat-trash-can-lid-20-gallon-gray-ph-743179', 'https://www.packaginghero.com/8-1-2-x-14-1-2-kraft-3-padded-mailers-ph-251135', 'https://www.packaginghero.com/60-x-36-x-63-4-shelf-wire-shelving-ph-715265', 'https://www.packaginghero.com/6-x-8-charcoal-waterhog-mat-ph-737270', 'https://www.packaginghero.com/box-of-rags-premium-white-50-lb-box-ph-827029', 'https://www.packaginghero.com/3-x-4-red-deluxe-vinyl-carpet-mat-ph-737464', 'https://www.packaginghero.com/deluxe-cowhide-leather-driver-glove-l-ph-891273', 'https://www.packaginghero.com/latex-industrial-gloves-powder-free-m-ph-891159', 'https://www.packaginghero.com/36-x-18-wire-shelves-ph-715331', 'https://www.packaginghero.com/11-5-8-x-8-3-8-x-4-blue-shelf-bins-ph-711325', 'https://www.packaginghero.com/3m-1100-foam-earplugs-ph-725101', 'https://www.packaginghero.com/23-5-8-x-6-5-8-x-4-yellow-shelf-bins-ph-711399', 'https://www.packaginghero.com/slim-jim-swing-top-lid-23-gallon-black-ph-742175', 'https://www.packaginghero.com/guarded-auto-retracting-safety-cutter-ph-732115', 'https://www.packaginghero.com/brute-flat-trash-can-lid-55-gallon-blue-ph-743277', 'https://www.packaginghero.com/nitrile-gloves-4-mil-large-ph-891185', 'https://www.packaginghero.com/5-shelf-wire-shelving-with-green-bins-ph-715155', 'https://www.packaginghero.com/vinyl-gloves-3-mil-powdered-xl-ph-891353', 'https://www.packaginghero.com/2-x-8-black-economy-anti-fatigue-mat-ph-737335', 'https://www.packaginghero.com/3-x-10-charcoal-vinyl-carpet-mat-ph-737530', 'https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-ivory-stack-hang-bin-ph-711111', 'https://www.packaginghero.com/nitrile-glove-accelerator-free-s-ph-891033', 'https://www.packaginghero.com/4-x-4-non-flammable-gas-labels-ph-413073', 'https://www.packaginghero.com/23-5-8-x-11-1-8-x-4-green-shelf-bins-ph-711413', 'https://www.packaginghero.com/36-x-24-x-86-wire-shelving-add-on-unit-ph-715179', 'https://www.packaginghero.com/second-chance-trash-bag-clear-33-gal-ph-755153', 'https://www.packaginghero.com/hd-trash-bag-black-33-gallon-63-mil-ph-754141', 'https://www.packaginghero.com/hd-trash-bag-natural-20-30-gal-63-mil-ph-754113', 'https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-yellow-stack-hang-bin-ph-711155', 'https://www.packaginghero.com/4-x-20-red-black-waterhog-runner-ph-737298', 'https://www.packaginghero.com/14-3-4-x-5-1-2-x-5-clear-stack-hang-bin-ph-711201', 'https://www.packaginghero.com/3-x-15-black-economy-anti-fatigue-mat-ph-737371', 'https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-yellow-stack-hang-bin-ph-711169', 'https://www.packaginghero.com/square-recycling-container-35-gal-blue-ph-742145', 'https://www.packaginghero.com/black-super-sharpie-markers-ph-734133', 'https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-green-stack-hang-bin-ph-711175', 'https://www.packaginghero.com/17-7-8-x-11-1-8-x-4-red-shelf-bins-ph-711377', 'https://www.packaginghero.com/3-x-60-red-economy-vinyl-carpet-mat-ph-737547', 'https://www.packaginghero.com/3-x-6-black-premium-anti-fatigue-mat-ph-737424', 'https://www.packaginghero.com/3-x-12-red-black-waterhog-mat-ph-737214', 'https://www.packaginghero.com/100-jersey-cotton-gloves-small-ph-891423', 'https://www.packaginghero.com/oil-dry-ph-843007', 'https://www.packaginghero.com/14-3-4-x-8-1-4-x-7-green-stack-hang-bin-ph-711217', 'https://www.packaginghero.com/11-5-8-x-4-1-8-x-4-green-shelf-bins-ph-711307', 'https://www.packaginghero.com/rsg-197-safety-grip-utility-knife-gray-ph-732113', 'https://www.packaginghero.com/2-x-60-yds-3m-301+-masking-tape-ph-681749', 'https://www.packaginghero.com/3.27-x-1476-black-zebra-thermal-transfer-ribbons-wax-ph-415139', 'https://www.packaginghero.com/8-pt-steel-track-snap-utility-knife-ph-732139', 'https://www.packaginghero.com/brute-trash-can-32-gallon-blue-ph-743189', 'https://www.packaginghero.com/plastic-knives-ph-882001', 'https://www.packaginghero.com/wypall-floor-jumbo-roll-dispenser-ph-843017', 'https://www.packaginghero.com/goatskin-leather-drivers-gloves-xlarge-ph-891281', 'https://www.packaginghero.com/10-7-8-x-11-x-5-green-stack-hang-bins-ph-711189', 'https://www.packaginghero.com/3-x-75-corrugated-rib-runners-ph-737575', 'https://www.packaginghero.com/3-x-5-premium-anti-fatigue-mat-ph-737423', 'https://www.packaginghero.com/donut-bumpers-for-swivel-casters-ph-715391', 'https://www.packaginghero.com/1.57-x-1181-black-datamax-thermal-transfer-ribbons-wax-ph-415103', 'https://www.packaginghero.com/green-marsh-88fx-metal-paint-markers-ph-734111', 'https://www.packaginghero.com/13-7-8-x-6-3-4-stack-hang-dividers-ph-712117', 'https://www.packaginghero.com/26-5-8-x-18-1-4-gray-stack-nest-lids-ph-717161', 'https://www.packaginghero.com/48-x-24-x-63-4-shelf-wire-shelving-ph-715217', 'https://www.packaginghero.com/20-7-8-x-18-1-4-gray-stack-nest-lids-ph-717155', 'https://www.packaginghero.com/leather-palm-w-safety-cuff-gloves-xl-ph-891313', 'https://www.packaginghero.com/20-7-8-x-18-1-4-x-9-7-8-blue-stack-nest-bin-ph-717127', 'https://www.packaginghero.com/16-x-11-x-8-yellow-stack-hang-bins-ph-711253', 'https://www.packaginghero.com/box-of-rags-premium-white-25-lb-box-ph-827027', 'https://www.packaginghero.com/glutton-recycling-container-lid-56-gal-ph-742151', 'https://www.packaginghero.com/4-x-12-medium-gray-waterhog-mat-ph-737254', 'https://www.packaginghero.com/10-7-8-x-11-x-5-yellow-stack-hang-bin-ph-711197', 'https://www.packaginghero.com/60-x-18-x-74-4-shelf-wire-shelving-ph-715237', 'https://www.packaginghero.com/nitrile-gloves-4-mil-small-ph-891181', 'https://www.packaginghero.com/virtua-ap-clear-protective-eyewear-ph-722107', 'https://www.packaginghero.com/brute-trash-can-10-gallon-red-ph-743139', 'https://www.packaginghero.com/fire-hose-9-x-6-facility-sign-ph-781153', 'https://www.packaginghero.com/4-x-6-gray-economy-anti-fatigue-mat-ph-737382', 'https://www.packaginghero.com/14-3-4-x-16-1-2-x-7-black-stack-hang-bin-ph-711233', 'https://www.packaginghero.com/3.14-x-1476-black-zebra-thermal-transfer-ribbons-ph-415131', 'https://www.packaginghero.com/1-x-60-yds-3m-9485.c-adhesive-transfer-tape-ph-651035', 'https://www.packaginghero.com/40-x-46-clear-can-liners-ph-751121', 'https://www.packaginghero.com/3-4-x-60-yds-3m-401+-233+-masking-tape-ph-681339', 'https://www.packaginghero.com/9-1-4-x-6-x-5-clear-stack-hang-bins-ph-711131', 'https://www.packaginghero.com/gritless-sweeping-compound-50-lb-bag-ph-842003', 'https://www.packaginghero.com/10-3-4-x-8-1-4-x-7-green-stack-hang-bin-ph-711147', 'https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-red-stack-hang-bin-ph-711165', 'https://www.packaginghero.com/2-x-105-corrugated-rib-runners-ph-737576', 'https://www.packaginghero.com/second-chance-trash-bag-black-33-gal-ph-755113', 'https://www.packaginghero.com/pink-sharpie-accent-highlighters-ph-734171', 'https://www.packaginghero.com/4-x-6-forest-green-deluxe-vinyl-carpet-ph-737475', 'https://www.packaginghero.com/glad-drawstring-trash-bag-13-gal-white-ph-753101', 'https://www.packaginghero.com/brute-flat-trash-can-lid-55-gal-white-ph-743285', 'https://www.packaginghero.com/48-x-24-x-63-wire-shelving-add-on-unit-ph-715219', 'https://www.packaginghero.com/3m-8271-oil-proof-respirator-with-valve-ph-723119', 'https://www.packaginghero.com/wypall-x60-wipers-bulk-pack-ph-844001', 'https://www.packaginghero.com/wire-shelving-s-hooks-ph-715393', 'https://www.packaginghero.com/17-7-8-x-4-1-8-x-4-blue-shelf-bins-ph-711343', 'https://www.packaginghero.com/cowhide-leather-driver-glove-lined-xl-ph-891269', 'https://www.packaginghero.com/wypall-x80-red-heavy-duty-wipers-roll-ph-843057', 'https://www.packaginghero.com/telephone-9-x-6-facility-sign-ph-781167', 'https://www.packaginghero.com/30-x-36-clear-can-liners-ph-751111', 'https://www.packaginghero.com/36-x-18-x-86-wire-shelving-add-on-unit-ph-715161', 'https://www.packaginghero.com/40-x-46-black-can-liners-ph-751169', 'https://www.packaginghero.com/16-x-10-x-8-7-8-red-stack-nest-bin-ph-717111', 'https://www.packaginghero.com/original-keybak-retractable-key-holder-ph-739105', 'https://www.packaginghero.com/2-x-10-black-yellow-anti-fatigue-mat-ph-737339', 'https://www.packaginghero.com/4-x-6-black-premium-anti-fatigue-mat-ph-737440', 'https://www.packaginghero.com/3-x-8-red-black-waterhog-mat-ph-737202', 'https://www.packaginghero.com/scott-blue-shop-towels-pop-up-box-ph-845007', 'https://www.packaginghero.com/18-x-27-green-waterhog-mat-ph-737169', 'https://www.packaginghero.com/18-x-8-1-4-x-9-yellow-stack-hang-bins-ph-711267', 'https://www.packaginghero.com/rubber-coated-palm-gloves-large-ph-891429', 'https://www.packaginghero.com/slim-jim-trash-can-23-gallon-beige-ph-742165', 'https://www.packaginghero.com/18-x-13-x-12-red-space-age-totes-ph-716111', 'https://www.packaginghero.com/red-sharpie-magnum-markers-ph-734147', 'https://www.packaginghero.com/ranger-trash-can-45-gallon-4-way-black-ph-748103', 'https://www.packaginghero.com/men-restroom-ada-compliant-plastic-sign-ph-781105', 'https://www.packaginghero.com/green-sharpie-fine-point-markers-ph-734123', 'https://www.packaginghero.com/door-sign-entrance-ph-781177', 'https://www.packaginghero.com/23-5-8-x-4-1-8-x-4-yellow-shelf-bins-ph-711389', 'https://www.packaginghero.com/aosafety-chemical-splash-goggles-334-ph-722103', 'https://www.packaginghero.com/17-7-8-x-11-1-8-x-4-yellow-shelf-bins-ph-711379', 'https://www.packaginghero.com/brute-flat-trash-can-lid-10-gal-white-ph-743155', 'https://www.packaginghero.com/3-x-12-charcoal-vinyl-carpet-mat-ph-737535', 'https://www.packaginghero.com/5-x-5-x-25-kraft-square-mailing-tubes-ph-213657', 'https://www.packaginghero.com/square-recycling-bottle-and-can-lid-blue-ph-742143', 'https://www.packaginghero.com/door-sign-private-ph-781187', 'https://www.packaginghero.com/super-48-retractable-key-holder-2-pack-ph-739103', 'https://www.packaginghero.com/wall-mountable-sanitary-napkin-receptacle-ph-825001', 'https://www.packaginghero.com/9-x-12-neon-red-job-ticket-holders-ph-731129', 'https://www.packaginghero.com/11-5-8-x-2-3-4-x-4-green-shelf-bins-ph-711299', 'https://www.packaginghero.com/6-x-10-kraft-0-padded-mailers-ph-251105', 'https://www.packaginghero.com/4-x-18-6-mil-reclosable-poly-bag-ph-315379', 'https://www.packaginghero.com/6-x-8-red-black-waterhog-mat-ph-737274', 'https://www.packaginghero.com/9-5-8-x-6-5-8-x-3-1-2-kraft-easy-fold-mailer-ph-212125', 'https://www.packaginghero.com/10-7-8-x-4-1-8-x-4-black-stack-hang-bin-ph-711163', 'https://www.packaginghero.com/10-7-8-x-11-x-5-red-stack-hang-bins-ph-711193', 'https://www.packaginghero.com/securit-retractable-key-holder-2-pack-ph-739101', 'https://www.packaginghero.com/6-x-30-4-mil-reclosable-poly-bag-ph-315367', 'https://www.packaginghero.com/brute-trash-can-10-gallon-gray-ph-743137', 'https://www.packaginghero.com/wypall-waterless-cleaning-wipes-ph-843005', 'https://www.packaginghero.com/second-chance-trash-bag-clear-6-bushel-ph-755159', 'https://www.packaginghero.com/ambidextrous-spring-back-safety-cutter-ph-732195', 'https://www.packaginghero.com/40-x-46-black-can-liners-ph-751167', 'https://www.packaginghero.com/60-x-36-wire-shelves-2-pack-ph-715359', 'https://www.packaginghero.com/36-x-24-x-74-4-shelf-wire-shelving-ph-715173', 'https://www.packaginghero.com/10-7-8-x-5-1-2-x-5-clear-stack-hang-bin-ph-711173', 'https://www.packaginghero.com/6-shelf-wire-shelving-with-red-bins-ph-715127', 'https://www.packaginghero.com/vinyl-gloves-5-mil-powder-free-m-ph-891373', 'https://www.packaginghero.com/18-x-8-1-4-x-9-black-stack-hang-bins-ph-711261', 'https://www.packaginghero.com/blue-marsh-88fx-metal-paint-markers-ph-734107', 'https://www.packaginghero.com/8-pt-steel-track-utility-knife-w-grip-ph-732135', 'https://www.packaginghero.com/this-room-is-for-your-convenience-6-x-9-facility-sign-ph-781135', 'https://www.packaginghero.com/rubbermaid-recycling-station-92-gallon-ph-742131', 'https://www.packaginghero.com/18-x-16-1-2-x-11-red-stack-hang-bins-ph-711291', 'https://www.packaginghero.com/second-chance-trash-bag-clear-20-30-gal-ph-755151', 'https://www.packaginghero.com/23-5-8-x-8-3-8-x-4-green-shelf-bins-ph-711405', 'https://www.packaginghero.com/3-x-60-premium-anti-fatigue-mat-ph-737437', 'https://www.packaginghero.com/glutton-recycling-container-56-gal-blue-ph-742149', 'https://www.packaginghero.com/1-1-2-x-60-yds-3m-201+-masking-tape-ph-681641', 'https://www.packaginghero.com/sb-92-standard-utility-blades-ph-732173', 'https://www.packaginghero.com/36-x-24-wire-shelves-ph-715335', 'https://www.packaginghero.com/6-x-8-medium-gray-waterhog-mat-ph-737272', 'https://www.packaginghero.com/17-x-14-1-2-x-9-7-8-blue-stack-nest-bin-ph-717115', 'https://www.packaginghero.com/60-x-36-x-54-4-shelf-wire-shelving-ph-715261', 'https://www.packaginghero.com/blue-recycling-trash-bag-33-gal-15-mil-ph-757111', 'https://www.packaginghero.com/4-x-60-brown-economy-vinyl-carpet-mat-ph-737564', 'https://www.packaginghero.com/11-5-8-x-6-5-8-x-4-green-shelf-bins-ph-711319', 'https://www.packaginghero.com/3-x-10-charcoal-deluxe-entry-mat-ph-737455', 'https://www.packaginghero.com/wypall-l40-108-x-10-all-purpose-wipers-ph-843023', 'https://www.packaginghero.com/black-sharpie-fine-point-markers-ph-734121', 'https://www.packaginghero.com/continuous-air-freshener-refill-citrus-ph-827009', 'https://www.packaginghero.com/60-x-24-x-74-4-shelf-wire-shelving-ph-715253', 'https://www.packaginghero.com/18-x-11-x-10-blue-stack-hang-bins-ph-711269', 'https://www.packaginghero.com/33-x-40-black-can-liners-ph-751165', 'https://www.packaginghero.com/33-x-40-black-can-liners-ph-751153', 'https://www.packaginghero.com/11-5-8-x-8-3-8-x-4-red-shelf-bins-ph-711331', 'https://www.packaginghero.com/goatskin-leather-drivers-gloves-large-ph-891279', 'https://www.packaginghero.com/18-x-11-x-10-green-stack-hang-bins-ph-711273', 'https://www.packaginghero.com/scott-1-ply-coreless-toliet-tissue-ph-821023', 'https://www.packaginghero.com/17-7-8-x-4-1-8-x-4-clear-shelf-bins-ph-711345', 'https://www.packaginghero.com/industrial-first-aid-kit-50-person-ph-724103', 'https://www.packaginghero.com/5-3-8-x-4-1-8-x-3-red-stack-hang-bins-ph-711109', 'https://www.packaginghero.com/48-x-18-x-54-wire-shelving-add-on-unit-ph-715199', 'https://www.packaginghero.com/wypall-x70-pro-wipers-bulk-pack-ph-843039', 'https://www.packaginghero.com/36-x-24-x-63-wire-shelving-add-on-unit-ph-715171', 'https://www.packaginghero.com/black-marsh-88fx-metal-paint-markers-ph-734109', 'https://www.packaginghero.com/1-x-60-yds-13m-301+-masking-tape-ph-681541', 'https://www.packaginghero.com/slim-jim-trash-can-23-gallon-black-ph-742167', 'https://www.packaginghero.com/6-shelf-wire-shelving-with-green-bins-ph-715123', 'https://www.packaginghero.com/second-chance-trash-bag-black-60-gal-ph-755143', 'https://www.packaginghero.com/18-x-19-wall-mounted-panel-rack-ph-714103', 'https://www.packaginghero.com/72-x-24-x-86-wire-shelving-add-on-unit-ph-715307', 'https://www.packaginghero.com/emergency-exit-only-6-x-9-facility-sign-ph-781125', 'https://www.packaginghero.com/5-x-20-4-mil-reclosable-poly-bag-ph-315361', 'https://www.packaginghero.com/6-x-16-medium-gray-waterhog-mat-ph-737290', 'https://www.packaginghero.com/4-x-6-charcoal-waterhog-mat-ph-737234'}
2025-11-01 09:08:21 [packaging_hero] (PID: 95) INFO: Finished processing 'not found' URLs in the `catalog_urls` table.
2025-11-01 09:08:21 [scrapy.extensions.feedexport] (PID: 95) INFO: Stored bq feed (467 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:11
2025-11-01 09:08:21 [scrapy.statscollectors] (PID: 95) INFO: Dumping Scrapy stats:
{'HeadersSpooferDownloaderMiddleware/spoofed': 26385,
 'NotFoundHandlerSpiderMiddleware/ProductNotFound': 1133,
 'NotFoundHandlerSpiderMiddleware/not_found/404_response': 1133,
 'NotFoundHandlerSpiderMiddleware/not_found/ignored': 1130,
 'NotFoundHandlerSpiderMiddleware/not_found/retrieved': 1132,
 'NotFoundHandlerSpiderMiddleware/not_found/table/stored': 2,
 'NotFoundHandlerSpiderMiddleware/not_found/table/to_store': 2,
 'big_query/url': 14402,
 'downloader/exception_count': 2962,
 'downloader/exception_type_count/builtins.ValueError': 2074,
 'downloader/exception_type_count/twisted.internet.error.ConnectionRefusedError': 876,
 'downloader/exception_type_count/twisted.internet.error.TimeoutError': 4,
 'downloader/exception_type_count/twisted.web._newclient.ResponseNeverReceived': 8,
 'downloader/request_bytes': 33863125,
 'downloader/request_count': 26385,
 'downloader/request_method_count/GET': 15875,
 'downloader/request_method_count/POST': 10510,
 'downloader/response_bytes': 404755100,
 'downloader/response_count': 25497,
 'downloader/response_status_count/200': 23481,
 'downloader/response_status_count/301': 876,
 'downloader/response_status_count/302': 7,
 'downloader/response_status_count/404': 1133,
 'dupefilter/filtered': 5031,
 'elapsed_time_seconds': 4090.358041,
 'feedexport/success_count/BigQueryFeedStorage': 11,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 11, 1, 9, 8, 18, 776441, tzinfo=datetime.timezone.utc),
 'httpcompression/response_bytes': 2741926612,
 'httpcompression/response_count': 24614,
 'item_scraped_count': 10467,
 'items_per_minute': None,
 'log_count/ERROR': 4212,
 'log_count/INFO': 1256,
 'log_count/WARNING': 13108,
 'memusage/max': 227561472,
 'memusage/startup': 126304256,
 'poet/injector/catalog_extraction.pages.packaging_hero.PackagingHeroProductsPageObject': 10467,
 'product_status/not_available_online': 216,
 'proxy_manager/ignored/proxy_defined': 2509,
 'proxy_manager/processed': 25950,
 'request_depth_max': 2,
 'response_received_count': 24614,
 'responses_per_minute': None,
 'retry/count': 1626,
 'retry/max_reached': 728,
 'retry/reason_count/Invalid response, retrying...': 1010,
 'retry/reason_count/twisted.internet.error.ConnectionRefusedError': 604,
 'retry/reason_count/twisted.internet.error.TimeoutError': 4,
 'retry/reason_count/twisted.web._newclient.ResponseNeverReceived': 8,
 'scheduler/dequeued': 28459,
 'scheduler/dequeued/memory': 28459,
 'scheduler/enqueued': 28459,
 'scheduler/enqueued/memory': 28459,
 'spider_exceptions/ProductNotFound': 1133,
 'spidermon/validation/fields': 219807,
 'spidermon/validation/items': 10467,
 'spidermon/validation/validators': 1,
 'spidermon/validation/validators/item/jsonschema': True,
 'spidermon_field_coverage/dict/brand': 1.0,
 'spidermon_field_coverage/dict/categories': 1.0,
 'spidermon_field_coverage/dict/countryOfOrigin': 1.0,
 'spidermon_field_coverage/dict/description': 1.0,
 'spidermon_field_coverage/dict/imageUrl': 1.0,
 'spidermon_field_coverage/dict/inStock': 1.0,
 'spidermon_field_coverage/dict/isFreeShipping': 1.0,
 'spidermon_field_coverage/dict/leadTime': 1.0,
 'spidermon_field_coverage/dict/manufacturer': 1.0,
 'spidermon_field_coverage/dict/manufacturerSku': 1.0,
 'spidermon_field_coverage/dict/name': 1.0,
 'spidermon_field_coverage/dict/packagingIncrement': 1.0,
 'spidermon_field_coverage/dict/prices': 1.0,
 'spidermon_field_coverage/dict/productStatus': 1.0,
 'spidermon_field_coverage/dict/relatedSkus': 1.0,
 'spidermon_field_coverage/dict/specifications': 1.0,
 'spidermon_field_coverage/dict/supplier': 1.0,
 'spidermon_field_coverage/dict/supplierSku': 1.0,
 'spidermon_field_coverage/dict/uom': 1.0,
 'spidermon_field_coverage/dict/url': 1.0,
 'spidermon_field_coverage/dict/weight': 1.0,
 'spidermon_item_scraped_count': 10467,
 'spidermon_item_scraped_count/dict': 10467,
 'spidermon_item_scraped_count/dict/brand': 10467,
 'spidermon_item_scraped_count/dict/categories': 10467,
 'spidermon_item_scraped_count/dict/countryOfOrigin': 10467,
 'spidermon_item_scraped_count/dict/description': 10467,
 'spidermon_item_scraped_count/dict/imageUrl': 10467,
 'spidermon_item_scraped_count/dict/inStock': 10467,
 'spidermon_item_scraped_count/dict/isFreeShipping': 10467,
 'spidermon_item_scraped_count/dict/leadTime': 10467,
 'spidermon_item_scraped_count/dict/manufacturer': 10467,
 'spidermon_item_scraped_count/dict/manufacturerSku': 10467,
 'spidermon_item_scraped_count/dict/name': 10467,
 'spidermon_item_scraped_count/dict/packagingIncrement': 10467,
 'spidermon_item_scraped_count/dict/prices': 10467,
 'spidermon_item_scraped_count/dict/productStatus': 10467,
 'spidermon_item_scraped_count/dict/relatedSkus': 10467,
 'spidermon_item_scraped_count/dict/specifications': 10467,
 'spidermon_item_scraped_count/dict/supplier': 10467,
 'spidermon_item_scraped_count/dict/supplierSku': 10467,
 'spidermon_item_scraped_count/dict/uom': 10467,
 'spidermon_item_scraped_count/dict/url': 10467,
 'spidermon_item_scraped_count/dict/weight': 10467,
 'start_requests/big_query': 14402,
 'start_time': datetime.datetime(2025, 11, 1, 8, 0, 8, 418400, tzinfo=datetime.timezone.utc)}
2025-11-01 09:08:21 [scrapy.core.engine] (PID: 95) INFO: Spider closed (finished)